-- Logs begin at Tue 2022-07-12 07:56:21 UTC, end at Tue 2022-07-12 08:57:02 UTC. -- Jul 12 08:22:30.092212 dv-cinder-797608-54-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Jul 12 08:22:30.100431 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: *** Starting uWSGI 2.0.18-debian (64bit) on [Tue Jul 12 08:22:30 2022] *** Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: nodename: dv-cinder-797608-54-iscsi Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: machine: x86_64 Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: clock source: unix Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: pcre jit disabled Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: detected number of CPU cores: 4 Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: current working directory: / Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: detected binary path: /usr/bin/uwsgi-core Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: your processes number limit is 47680 Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: your memory page size is 4096 bytes Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: detected max file descriptor number: 2048 Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: lock engine: pthread robust mutexes Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: thunder lock: enabled Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 12 08:22:30.106643 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 12 08:22:30.150174 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: Python main interpreter initialized at 0x55cb5440a9c0 Jul 12 08:22:30.150174 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: python threads support enabled Jul 12 08:22:30.150174 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: your server socket listen backlog is limited to 100 connections Jul 12 08:22:30.150174 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: your mercy for graceful operations on workers is 90 seconds Jul 12 08:22:30.150527 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: mapped 403077 bytes (393 KB) for 2 cores Jul 12 08:22:30.150609 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: *** Operational MODE: preforking *** Jul 12 08:22:30.150870 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: *** uWSGI is running in multiple interpreter mode *** Jul 12 08:22:30.150870 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: spawned uWSGI master process (pid: 80178) Jul 12 08:22:30.151074 dv-cinder-797608-54-iscsi systemd[1]: Started Devstack devstack@keystone.service. Jul 12 08:22:30.151861 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: spawned uWSGI worker 1 (pid: 80191, cores: 1) Jul 12 08:22:30.151956 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: spawned uWSGI worker 2 (pid: 80192, cores: 1) Jul 12 08:22:30.152115 dv-cinder-797608-54-iscsi devstack@keystone.service[80178]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 12 08:22:35.636224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 08:22:35.636224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes Jul 12 08:22:35.636995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 08:22:35.636995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: from cryptography.utils import int_from_bytes Jul 12 08:22:35.637300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 08:22:35.637300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: from cryptography.utils import int_from_bytes Jul 12 08:22:35.637770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 12 08:22:35.637770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: from cryptography.utils import int_from_bytes Jul 12 08:22:35.687521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 08:22:35.687690 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 08:22:35.687888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] command line args: [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 08:22:35.688162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 08:22:35.688365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ================================================================================ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 08:22:35.688644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.688923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_dir = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.689150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.689368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] config_source = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.689610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] debug = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.689834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.691469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 12 08:22:35.691545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.691545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.691545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.691545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.691545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.691807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 12 08:22:35.691872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_config_append = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.691932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] command line args: [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 12 08:22:35.691995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.691995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_dir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.692118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 12 08:22:35.692177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.692234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ================================================================================ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 12 08:22:35.692298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.692358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] admin_token = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.692423 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.692483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] config_dir = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.693046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.693259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.693259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] config_source = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.693678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.693888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] debug = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.694090 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.694262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.694535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.694705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.694939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.695106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.695301 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.695498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.695693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.695930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.696130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.696299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.696529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.696696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_config_append = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.696934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.697145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.697145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_dir = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.697549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.697719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.697885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.698049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.698189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.698371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.698371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.698660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.698797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.698939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] publish_errors = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.699084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.699216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.699393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.699537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.699685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.699823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.699960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.700098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.700235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.700364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.700505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.700642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] standard_threads = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.700821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.700958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.701088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.701218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.701356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.701525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.701525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_journal = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.701780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.701927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_json = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.702079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.702212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_stderr = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.702212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] use_syslog = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.702212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.702584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.702772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.702906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] publish_errors = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.703036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.703171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.703171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.703500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.703632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.703763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.703892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.704028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.704167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.704298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.704428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] standard_threads = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.704570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.704707 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.704844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.704986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.705124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.705255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.705255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_journal = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.705522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.705653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_json = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.705798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.705930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_stderr = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.705930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] use_syslog = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.706188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.706336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 12 08:22:35.706601 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.706776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.706913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.707054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.707185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.707315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.707444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.707584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.707720 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.707851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.707981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.708117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.708247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.708399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.708530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.708660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.708789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.708919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.709055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.709258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.709258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.709558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.709692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.709828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.709958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.710100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.710232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.710373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.710504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.710633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.710763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.710902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.711039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.711176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.711314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.711446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.711575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.711714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.711845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.711981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.712125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.712257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.712395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.712532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.712532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.712784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.712921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.713051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.713190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.713320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.713498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.713711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.713876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.714020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.714169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.714301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.714436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.714567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.714696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.714826 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.714963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.715093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.715229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.715366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.715502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.715632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.715980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.716110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.716239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.716376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.716507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.716645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.716775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.716905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.717035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.717165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.717295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.717462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.717600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.717739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.719453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.719653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.719854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.720096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.720265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.720461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.720660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.720856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.721052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.721287 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.721496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.721696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.721894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.722102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.722376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.722608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.722776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.722973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.723172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.723403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.723618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.723824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.723992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.724191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.724388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.724554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.724690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.724883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.725025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.725267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.725491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.725642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.725776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.725941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.726085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.726217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.726348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.726480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.726617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.726749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.726903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.727037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.727169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.727330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.727472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.727619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.727751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.727893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.728963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.729211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.729355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.729517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.729656 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.729794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.729959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.730125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.730125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.730384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.730516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.730658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.730789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.730920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.731063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.731195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.731326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.731456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.731594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.731726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.731874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.732007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.732145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.732277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.732407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.732554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.732761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.732895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.733027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.733165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.733296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.733456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.733606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.733748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.734505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.734642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.734782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.734914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.735057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.735190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.735330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.735461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.735592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.735723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.735854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.735991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.736134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.736266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.external = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.736397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.736528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.736660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.736801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.736944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.737076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.737207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.737345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.password = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.737608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.737757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] auth.token = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.737897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.738029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.738161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.738292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.738430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.738570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.738742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.738888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.739032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.739172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.739306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.739438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.739569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.739709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.739842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.external = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.739980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.740113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.740251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.740384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.740526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.740659 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.740801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.740933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.password = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.741064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.741196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] auth.token = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.741338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.741503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.741639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.741777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.741913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.742044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.742187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.742320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.742451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.742583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.742725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.742856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.742996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.743129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.743260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.743391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.743522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.743660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.743800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.743938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.744079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.744213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.744344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.744486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.744627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.744760 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.744892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.745024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.745155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.745286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.745475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.745616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.745749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.745882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.746014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.746145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.746288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.746434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.746567 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.746699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.746838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.746971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.747111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.747243 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.747374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.747506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.747637 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.747769 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.747913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.748047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.748188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.748320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.748546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.748712 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.748712 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.748978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.749124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.749257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.749409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.749930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.750071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.750205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.750344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.750477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.750621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.750762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.750895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.751028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.751160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.751292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.751423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.751564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.751698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.751843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.751981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.752113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.752246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.752397 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.752531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.752663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.752794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.752926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.753059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.753200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.753333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.753495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.753634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.753766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.753897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.754040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.754174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.754321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.754453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.754585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.754717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.754857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.754991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.755124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.755255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.755387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.755518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.755657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.755790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.755922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.756063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.756197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.756328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.756469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.756602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.756734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.756865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.756997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.757127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.757267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.757400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.757579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.757711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.757843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.757983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.758127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.758262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.758393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.758525 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.758656 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.758788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.758928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.759070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.759203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.759335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.759466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.759597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.759737 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.759885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.760018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.760150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.760281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.760413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.760553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.760686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.760818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.760949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.761081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.761212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.761356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.761521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.761671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.761807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.761939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.762070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.762214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.762346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.762479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.762610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.762741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.762872 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.763012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.763144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.763276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.763407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.763550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.763691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.763823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.763955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.764092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.764224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.764355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.764495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.764678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.764818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.764950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.765856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.765999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.766150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.766297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.766430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.766562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.766694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.766827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.766967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.767100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.767232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.767363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.767502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.767634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.767775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.767909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.768051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.768183 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.768314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.768445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.768585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.768728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.768861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.768998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.769130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.769261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.769401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.769604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.769737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.769869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.770021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.770154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.770294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.770432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.770564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.770695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.770827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.770958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.771097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.771236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.771368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.771499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.771630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.771760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.771911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.772044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.772179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.772317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.772449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.772839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.772990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.773124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.773255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.773387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.773551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.773683 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.773827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.773972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.774104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.774234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.774365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.774750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.774891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.775023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.775154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.775285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.775417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.775547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.775687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.775819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.775950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.776092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.776223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.776354 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.776493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.776626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.776756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.776887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.777018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.777149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.777395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.777553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.777688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.777820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.777947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.778086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.778237 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.778371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.778504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.778636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.778767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.778897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.779038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.779175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.779307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.779477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.779616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] role.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.779756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.779898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] role.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.780030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.780162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.780294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.780426 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.780570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.780756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.780756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.781584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.781754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.781901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.782049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.782188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.782331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.782464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.782597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.782729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.782869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.783002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.783135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.783266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.783398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.783530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.783670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.783803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.783934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.784076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.784209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.784348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.784348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.784609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.784740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.784872 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.785004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.785135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.785276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.785408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.785566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.785698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.785829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.785971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.786115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.786251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.786383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.786515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.786648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.786788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.786921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.787053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.787185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.787316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.787447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.787447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.787717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.787849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.787980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.788112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.788244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.788384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.788517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.788651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.788782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.788920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.789053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.789193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.789325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.789475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.789625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.789800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.789971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.790118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.790252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.790383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.790516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.790648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.790781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.790921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.791055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.791187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.791319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.791450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.791602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.791744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.791884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.792031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.792164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.792296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.792428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.792560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.792691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.792831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.792965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.793098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.793230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.793372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.793545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.793691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.793824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.793965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.794098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.794230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.794362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.794502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.794635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.794767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.794899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.795040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.795182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.795335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.795477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.795609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.795741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.795873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.796012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.796145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.796517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.796669 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.796803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80192) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.797231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.798372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.798372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.798372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 12 08:22:35.798372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80191) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 12 08:22:35.807145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.807317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.807458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.807606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.807743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.807879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.816315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.816475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.845038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.845288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.845870 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.846108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.992919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:35.993231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.041588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.041839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.043996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.044235 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.105931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.106186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.106347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.106616 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.106777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.106928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.107061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.107061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.107311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.107311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.107572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.107572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.132278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.132510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.132663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.132800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.132951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.133087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.133218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.133357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.133590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.133736 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.133867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.133998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.134129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.134129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.144749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.145541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.159089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.159351 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.159514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.159795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.159996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.159996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.160252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.160393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.160526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.160670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80191) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.160801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.160801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.160801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.161219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80192) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 12 08:22:36.178209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.178401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 08:22:36.178743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.178949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 08:22:36.179214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.179470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.179755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.179896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.180027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 08:22:36.180166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.180296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.180449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 12 08:22:36.180716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.180978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.181232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.181506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.191411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.191687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.191954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.192231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.193120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.193396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.193686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.193961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.200528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.202271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.204535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.204808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.205086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.205367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.205676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.205934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.206199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.206354 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.206586 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.206751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.206893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.207025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.207156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.207296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.207427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.207556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.207556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.207810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.208077 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.208343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.208614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.208878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.234246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.235602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.235954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.236231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.237229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.237530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.241579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.241858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.242138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.242865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.243197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.243561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.250626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.250937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.251762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.252065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.255927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.256211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.256491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.256712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.256855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.257014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.257172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.257303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.257464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.257616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.257748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.257878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.258116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.258386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.258654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.277463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.278047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.278838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.279137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.282565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.283928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.286344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.286647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.287686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.287993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.291962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.293282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.295674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.297240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.299439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.299749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.300032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.300325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.300617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.300892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.301031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.301234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.301542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.301839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.302125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.302413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.320893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.321192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.321460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.321726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.322426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.322734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.323006 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.323268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.330065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.331458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.331822 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.332097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.333219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.333519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.335463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.335749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.336033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.336326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.336605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.336779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.337065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.337348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.337649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.337932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.350936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.351249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.351507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.351783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.351934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.352089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.352234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.352375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.352596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.353048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.353342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.353651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.355406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.355692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.373084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.374843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.376467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.378392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.379830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.381467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.381739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.383255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.383497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.383634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.383800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.385159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.385490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.385745 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.391255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.392888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.394347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.395981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.396156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.396448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.396730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.397002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.399943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.400230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.400626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.400902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.407132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.407419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.407696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.410831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.411272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.411691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.415851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80191) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.416136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.416415 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.416688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.416956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.417231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.417610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.420009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.420009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.420009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.420009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.420009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.420009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.420709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80191) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.420829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80192) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 12 08:22:36.420963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.421188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.422098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.422368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.422770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.423050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.423329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.423610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.423883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.424164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.424433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.424707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.424972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80192) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 12 08:22:36.458137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb5440a9c0 pid: 80191 (default app) Jul 12 08:22:36.461589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce4d0-b462-4a9d-81bd-b97bbd0a568d None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:36.461881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce4d0-b462-4a9d-81bd-b97bbd0a568d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:36.462157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71ce4d0-b462-4a9d-81bd-b97bbd0a568d None None] PATH_INFO: `/v3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:36.463029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cb5440a9c0 pid: 80192 (default app) Jul 12 08:22:36.466368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Tue Jul 12 08:22:36 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:44.090285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01668b37-9792-4093-b1bf-a3ceb704f62f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:44.090854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01668b37-9792-4093-b1bf-a3ceb704f62f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:44.090854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01668b37-9792-4093-b1bf-a3ceb704f62f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:44.095751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:44 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:22:44.101025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:44.101482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:44.101608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:44.170944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: INFO dbcounter [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] Registered counter for database keystone Jul 12 08:22:44.192022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG oslo_db.sqlalchemy.engines [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80191) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 08:22:44.198226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writer thread running {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 08:22:44.373258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG passlib.handlers.bcrypt [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80191) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 08:22:44.373636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG passlib.handlers.bcrypt [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80191) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 08:22:44.429686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:44.431291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:44.552438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:44 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 452 msecs (HTTP/1.1 201) 6 headers in 384 bytes (2 switches on core 0) Jul 12 08:22:44.750409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01668b37-9792-4093-b1bf-a3ceb704f62f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:44.819704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: INFO dbcounter [None req-01668b37-9792-4093-b1bf-a3ceb704f62f None None] Registered counter for database keystone Jul 12 08:22:44.840157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG oslo_db.sqlalchemy.engines [None req-01668b37-9792-4093-b1bf-a3ceb704f62f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80192) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 12 08:22:44.846884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writer thread running {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 12 08:22:44.965528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01668b37-9792-4093-b1bf-a3ceb704f62f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:44.970311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0625910e-e38a-451b-9c5e-25e80669a68a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:44.970969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625910e-e38a-451b-9c5e-25e80669a68a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:44.971253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625910e-e38a-451b-9c5e-25e80669a68a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:44.971528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0625910e-e38a-451b-9c5e-25e80669a68a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:44.979576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625910e-e38a-451b-9c5e-25e80669a68a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:45.031862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING keystone.common.rbac_enforcer.enforcer [None req-0625910e-e38a-451b-9c5e-25e80669a68a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 08:22:45.032201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0625910e-e38a-451b-9c5e-25e80669a68a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:45.041647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Jul 12 08:22:44 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:22:45.048546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:45.063970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-557af72c-ad6f-4e1d-9856-0ce00d1e5bc9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:45.068396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6158b216-a986-46a8-bbb0-f296b0ecc319 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:45.069558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158b216-a986-46a8-bbb0-f296b0ecc319 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:45.069851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158b216-a986-46a8-bbb0-f296b0ecc319 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:45.070129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6158b216-a986-46a8-bbb0-f296b0ecc319 admin admin] PATH_INFO: `/v3/projects/9d63d9615eff4164ace798b1726ec64c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:45.071626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158b216-a986-46a8-bbb0-f296b0ecc319 admin admin] RBAC: Authorizing `identity:get_project(project_id=9d63d9615eff4164ace798b1726ec64c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:45.127558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING keystone.common.rbac_enforcer.enforcer [None req-6158b216-a986-46a8-bbb0-f296b0ecc319 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 12 08:22:45.128181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6158b216-a986-46a8-bbb0-f296b0ecc319 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:45.133976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Tue Jul 12 08:22:45 2022] GET /identity/v3/projects/9d63d9615eff4164ace798b1726ec64c => generated 344 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:47.144358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bdc51-0d20-49a0-b59e-abef7ab23ae3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:47.144891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bdc51-0d20-49a0-b59e-abef7ab23ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:47.144986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94bdc51-0d20-49a0-b59e-abef7ab23ae3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:47.149041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:22:47.154813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c13020-d38e-43c0-808c-56f140a65c35 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:47.155180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c13020-d38e-43c0-808c-56f140a65c35 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:47.155367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c13020-d38e-43c0-808c-56f140a65c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:47.174402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e5c13020-d38e-43c0-808c-56f140a65c35 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:47.175924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e5c13020-d38e-43c0-808c-56f140a65c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:47.183611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:47 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 12 08:22:47.205929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bdc51-0d20-49a0-b59e-abef7ab23ae3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:47.217824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94bdc51-0d20-49a0-b59e-abef7ab23ae3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:47.222950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c20304-cd9f-42d3-b643-bae99190c1bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:47.223576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20304-cd9f-42d3-b643-bae99190c1bc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:47.223858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20304-cd9f-42d3-b643-bae99190c1bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:47.224132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c20304-cd9f-42d3-b643-bae99190c1bc admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:47.231768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c20304-cd9f-42d3-b643-bae99190c1bc admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:47.233573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25c20304-cd9f-42d3-b643-bae99190c1bc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:47.242267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Tue Jul 12 08:22:47 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:22:47.247587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c13020-d38e-43c0-808c-56f140a65c35 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:47.256796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c13020-d38e-43c0-808c-56f140a65c35 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:47.261095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9dfc3f-3c18-4d61-9aa2-88e468e3ab69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:47.261993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dfc3f-3c18-4d61-9aa2-88e468e3ab69 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:47.262279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dfc3f-3c18-4d61-9aa2-88e468e3ab69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:47.262553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9dfc3f-3c18-4d61-9aa2-88e468e3ab69 admin admin] PATH_INFO: `/v3/users/a284f7c10ba148eab43b0163d0db6ba7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:47.263949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dfc3f-3c18-4d61-9aa2-88e468e3ab69 admin admin] RBAC: Authorizing `identity:get_user(user_id=a284f7c10ba148eab43b0163d0db6ba7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:47.266312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9dfc3f-3c18-4d61-9aa2-88e468e3ab69 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:47.267870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Tue Jul 12 08:22:47 2022] GET /identity/v3/users/a284f7c10ba148eab43b0163d0db6ba7 => generated 247 bytes in 21 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:49.333290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2c4e7-e895-4c23-a8b0-8f23b42f45dd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:49.333875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2c4e7-e895-4c23-a8b0-8f23b42f45dd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:49.333875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c2c4e7-e895-4c23-a8b0-8f23b42f45dd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:49.335249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:22:49.340423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebadbf-394a-4d39-bef0-a0771589a219 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:49.340808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebadbf-394a-4d39-bef0-a0771589a219 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:49.340974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6ebadbf-394a-4d39-bef0-a0771589a219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:49.357937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f6ebadbf-394a-4d39-bef0-a0771589a219 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:49.359160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f6ebadbf-394a-4d39-bef0-a0771589a219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:49.394377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9e96-618d-4c8f-a0ca-1a84f7a98029 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:49.394662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9e96-618d-4c8f-a0ca-1a84f7a98029 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:49.396810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd9e96-618d-4c8f-a0ca-1a84f7a98029 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:49.396810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:22:49.401915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:49.402200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:49.402478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:49.441819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80192) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 12 08:22:49.442245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG passlib.handlers.bcrypt [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80192) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 12 08:22:49.443802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:22:49.466936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebadbf-394a-4d39-bef0-a0771589a219 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:49.488235 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:49.489856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:49.490472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:49.570380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6ebadbf-394a-4d39-bef0-a0771589a219 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:49.589297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:22:49.605631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2f948-6541-4dcc-8e12-928ede6d5ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:49.606429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2f948-6541-4dcc-8e12-928ede6d5ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:49.606708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2f948-6541-4dcc-8e12-928ede6d5ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:49.606978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c2f948-6541-4dcc-8e12-928ede6d5ea6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:49.611845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:49.618880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c2f948-6541-4dcc-8e12-928ede6d5ea6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-44c2f948-6541-4dcc-8e12-928ede6d5ea6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:22:49.630533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:22:49.631553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:22:49.632384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:22:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:22:49.637489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2f948-6541-4dcc-8e12-928ede6d5ea6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:49.714358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0987ee3c-4b3f-439b-b759-a548ec701656 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:49.716604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:49.722550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:49.743894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c2f948-6541-4dcc-8e12-928ede6d5ea6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:49.751735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a3c0a-b5c6-49f5-8805-fd98779f3caf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:49.752635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a3c0a-b5c6-49f5-8805-fd98779f3caf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:49.752922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a3c0a-b5c6-49f5-8805-fd98779f3caf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:49.753200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5a3c0a-b5c6-49f5-8805-fd98779f3caf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:49.778376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:49.779033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:49.779310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:49.779581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:49.780330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:22:49.780653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:49.782070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:49.793326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:22:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:22:49.798752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:49.829859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a3c0a-b5c6-49f5-8805-fd98779f3caf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:49.831404 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c5a3c0a-b5c6-49f5-8805-fd98779f3caf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:49.897990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3560c57-12d4-4a47-b876-ad447610752a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:49.929182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:22:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 08:22:49.930894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818c8c-02c0-4ae3-9efb-f6e00ce3e15e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:49.931772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818c8c-02c0-4ae3-9efb-f6e00ce3e15e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:49.932052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818c8c-02c0-4ae3-9efb-f6e00ce3e15e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:49.932327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf818c8c-02c0-4ae3-9efb-f6e00ce3e15e None admin] PATH_INFO: `/v3/users/a284f7c10ba148eab43b0163d0db6ba7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:49.933561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf818c8c-02c0-4ae3-9efb-f6e00ce3e15e None admin] RBAC: Authorizing `identity:get_user(user_id=a284f7c10ba148eab43b0163d0db6ba7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:49.934879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a3c0a-b5c6-49f5-8805-fd98779f3caf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:49.935056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf818c8c-02c0-4ae3-9efb-f6e00ce3e15e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:49.936630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:22:49 2022] GET /identity/v3/users/a284f7c10ba148eab43b0163d0db6ba7 => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:22:49.938507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:49.942394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818c8c-02c0-4ae3-9efb-f6e00ce3e15e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:49.957608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:50.033092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5a3c0a-b5c6-49f5-8805-fd98779f3caf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:50.042936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf818c8c-02c0-4ae3-9efb-f6e00ce3e15e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:50.067556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:50.068344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:50.068620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:50.068968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:50.076210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd122f1-70a2-42d8-83ea-b6d30f661875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:50.076995 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd122f1-70a2-42d8-83ea-b6d30f661875 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:50.077276 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd122f1-70a2-42d8-83ea-b6d30f661875 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:50.078087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd122f1-70a2-42d8-83ea-b6d30f661875 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:50.079430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd122f1-70a2-42d8-83ea-b6d30f661875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:50.080860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd122f1-70a2-42d8-83ea-b6d30f661875 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:50.082490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 10/18] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:22:49 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:22:50.087512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:50.088275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd122f1-70a2-42d8-83ea-b6d30f661875 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:50.088961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:22:50.112655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:22:50.113607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:22:50.114420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:22:50.114420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:22:50.114420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:22:50.114420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:22:50.114420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 9/19] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:22:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:22:50.119926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:50.168872 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:50.176609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:50.194564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd122f1-70a2-42d8-83ea-b6d30f661875 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:50.221487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198ee136-e635-4ab1-83ef-2b1404efd665 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:50.231172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3f0765c-ec7a-46db-ac5e-10114317bfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:50.231831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0765c-ec7a-46db-ac5e-10114317bfa1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:50.232115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0765c-ec7a-46db-ac5e-10114317bfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:50.232391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3f0765c-ec7a-46db-ac5e-10114317bfa1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:50.233223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0765c-ec7a-46db-ac5e-10114317bfa1 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.domain.id=default, user.id=a284f7c10ba148eab43b0163d0db6ba7) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:22:50.233564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0765c-ec7a-46db-ac5e-10114317bfa1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:50.235521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3f0765c-ec7a-46db-ac5e-10114317bfa1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:50.242233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 11/20] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Jul 12 08:22:50 2022] GET /identity/v3/role_assignments?user.id=a284f7c10ba148eab43b0163d0db6ba7&scope.domain.id=default&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:22:50.254359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254fe4-0638-42a4-aa6c-94d81cd5c672 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:50.255047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254fe4-0638-42a4-aa6c-94d81cd5c672 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:50.255327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254fe4-0638-42a4-aa6c-94d81cd5c672 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:50.255598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254fe4-0638-42a4-aa6c-94d81cd5c672 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:50.256342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be254fe4-0638-42a4-aa6c-94d81cd5c672 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:22:50.256643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be254fe4-0638-42a4-aa6c-94d81cd5c672 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:50.258142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be254fe4-0638-42a4-aa6c-94d81cd5c672 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:50.278655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 10/21] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:22:52.568832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab61b-c8e4-4851-ad3c-3be0cfe0fd1b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:52.569323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab61b-c8e4-4851-ad3c-3be0cfe0fd1b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:52.569527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfaab61b-c8e4-4851-ad3c-3be0cfe0fd1b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:52.570761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 12/22] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:22:52.591435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774aee31-87ba-4aca-af72-5800a2ab5f50 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:52.591915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774aee31-87ba-4aca-af72-5800a2ab5f50 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:52.591986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774aee31-87ba-4aca-af72-5800a2ab5f50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:52.622440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-774aee31-87ba-4aca-af72-5800a2ab5f50 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:52.623661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-774aee31-87ba-4aca-af72-5800a2ab5f50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:52.720004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 11/23] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:22:52.765225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab61b-c8e4-4851-ad3c-3be0cfe0fd1b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:52.823806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c04e-256f-44c7-b7b3-114743063700 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:52.824139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c04e-256f-44c7-b7b3-114743063700 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:52.824379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a7c04e-256f-44c7-b7b3-114743063700 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:52.826095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 12/24] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:22:52.852963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6384-d928-4615-8bdc-f4f9686d3426 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:52.853250 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6384-d928-4615-8bdc-f4f9686d3426 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:52.853564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-156e6384-d928-4615-8bdc-f4f9686d3426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:52.894582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-156e6384-d928-4615-8bdc-f4f9686d3426 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:52.895808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-156e6384-d928-4615-8bdc-f4f9686d3426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:52.931333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfaab61b-c8e4-4851-ad3c-3be0cfe0fd1b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:53.006205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05d264c-7b5d-49e6-afae-39d57523f809 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:53.007526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d264c-7b5d-49e6-afae-39d57523f809 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.008097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d264c-7b5d-49e6-afae-39d57523f809 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.008567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05d264c-7b5d-49e6-afae-39d57523f809 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.016255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:53.029724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d264c-7b5d-49e6-afae-39d57523f809 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:53.032207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05d264c-7b5d-49e6-afae-39d57523f809 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:53.043054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-a05d264c-7b5d-49e6-afae-39d57523f809 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:22:53.068340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:22:53.069196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:22:53.070466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:22:53.070466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:22:53.070466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:22:53.070466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:22:53.070466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 13/25] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:22:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:22:53.071013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a91a-9e81-4b4e-8bf8-67fe78121a9f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.072871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a91a-9e81-4b4e-8bf8-67fe78121a9f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.072871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a227a91a-9e81-4b4e-8bf8-67fe78121a9f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.072871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 14/26] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:22:53.076814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 13/27] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 225 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:22:53.082569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a91a-9e81-4b4e-8bf8-67fe78121a9f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:53.083206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e578b-9c51-4696-91da-643a08ff28d1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.083598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e578b-9c51-4696-91da-643a08ff28d1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.083882 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3e578b-9c51-4696-91da-643a08ff28d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.101198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fc3e578b-9c51-4696-91da-643a08ff28d1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:53.102500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc3e578b-9c51-4696-91da-643a08ff28d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:53.175004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 14/28] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:22:53.175844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e578b-9c51-4696-91da-643a08ff28d1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:53.248835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a227a91a-9e81-4b4e-8bf8-67fe78121a9f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:53.302790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:53.303564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.303847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.304126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.304913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:22:53.305224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:53.306696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:53.326128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 15/29] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:22:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:53.327063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:53.345900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3e578b-9c51-4696-91da-643a08ff28d1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:53.354331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:53.383526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b4b577-3007-4a99-aadd-28f503e21e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:53.384297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4b577-3007-4a99-aadd-28f503e21e6c None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.384644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4b577-3007-4a99-aadd-28f503e21e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.384989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b4b577-3007-4a99-aadd-28f503e21e6c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.385827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4b577-3007-4a99-aadd-28f503e21e6c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:53.387306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b4b577-3007-4a99-aadd-28f503e21e6c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:53.397982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:53.454984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f35a6f5-a33f-4420-8cd8-5d34f0675385 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:53.492163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aacbab7b-281a-4f90-b7b6-cff9333bf54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:53.493190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbab7b-281a-4f90-b7b6-cff9333bf54e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.493509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbab7b-281a-4f90-b7b6-cff9333bf54e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.493978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aacbab7b-281a-4f90-b7b6-cff9333bf54e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.509888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aacbab7b-281a-4f90-b7b6-cff9333bf54e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-aacbab7b-281a-4f90-b7b6-cff9333bf54e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:22:53.518023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:22:53.519036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:22:53.519985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 16/30] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:22:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:22:53.520664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48da8-fc4e-4a3a-a992-232bdf3e0b6e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.520858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48da8-fc4e-4a3a-a992-232bdf3e0b6e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.521136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bd48da8-fc4e-4a3a-a992-232bdf3e0b6e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.522468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 17/31] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:22:53.523142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd48da8-fc4e-4a3a-a992-232bdf3e0b6e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:53.562145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 15/32] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 12 08:22:53 2022] POST /identity/v3/roles => generated 219 bytes in 386 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:22:53.565053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b52b4-a306-4c99-9791-1b696dc517d6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.565550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b52b4-a306-4c99-9791-1b696dc517d6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.565997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6b52b4-a306-4c99-9791-1b696dc517d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.605254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ba6b52b4-a306-4c99-9791-1b696dc517d6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:53.606876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba6b52b4-a306-4c99-9791-1b696dc517d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:53.708650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 16/33] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:22:53.710176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b52b4-a306-4c99-9791-1b696dc517d6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:53.743471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bd48da8-fc4e-4a3a-a992-232bdf3e0b6e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:53.781735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:53.808924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31d89-059f-433d-8b12-f8fcf6224b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:53.809665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31d89-059f-433d-8b12-f8fcf6224b57 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.809951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31d89-059f-433d-8b12-f8fcf6224b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.810225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb31d89-059f-433d-8b12-f8fcf6224b57 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.811018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31d89-059f-433d-8b12-f8fcf6224b57 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:53.813199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb31d89-059f-433d-8b12-f8fcf6224b57 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:53.837818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:53.844864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6b52b4-a306-4c99-9791-1b696dc517d6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:53.885111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:53.886008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:53.886394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:53.886739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:53.887741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:22:53.888115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:53.889795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:53.903887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 17/34] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:22:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:53.904803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:53.970426 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 18/35] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:22:53 2022] POST /identity/v3/projects => generated 301 bytes in 447 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:22:53.978381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31d89-059f-433d-8b12-f8fcf6224b57 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:54.014463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5973f6bb-2a6a-4a2a-a083-a04b4d334f40 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:54.054757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069ac1d5-b0cc-405e-9dd9-1dc6c2f3c3a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:54.055434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ac1d5-b0cc-405e-9dd9-1dc6c2f3c3a6 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.055719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ac1d5-b0cc-405e-9dd9-1dc6c2f3c3a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.055997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069ac1d5-b0cc-405e-9dd9-1dc6c2f3c3a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.056813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ac1d5-b0cc-405e-9dd9-1dc6c2f3c3a6 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:54.061458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069ac1d5-b0cc-405e-9dd9-1dc6c2f3c3a6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:54.081138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 18/36] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 12 08:22:53 2022] POST /identity/v3/roles => generated 225 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:22:54.142929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa78b74-edc7-437f-9cd8-91b2672fee92 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.143245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa78b74-edc7-437f-9cd8-91b2672fee92 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.143491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa78b74-edc7-437f-9cd8-91b2672fee92 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.145316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 19/37] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:22:54.151148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49a24e-7ffc-45a2-b3fb-f55b1e553356 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.151458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49a24e-7ffc-45a2-b3fb-f55b1e553356 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.151704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f49a24e-7ffc-45a2-b3fb-f55b1e553356 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.185187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4f49a24e-7ffc-45a2-b3fb-f55b1e553356 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:54.186482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f49a24e-7ffc-45a2-b3fb-f55b1e553356 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:54.221165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:54.310190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 20/38] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:22:54.311532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f69b-3355-4fac-81da-4c27de67827c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.312406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f69b-3355-4fac-81da-4c27de67827c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.312665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1f69b-3355-4fac-81da-4c27de67827c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.314038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 21/39] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:22:54.319202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf394-2f75-4bff-a5f5-ee72ef609c01 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.319322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb31d89-059f-433d-8b12-f8fcf6224b57 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:54.319510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf394-2f75-4bff-a5f5-ee72ef609c01 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.319760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29bf394-2f75-4bff-a5f5-ee72ef609c01 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.337569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b29bf394-2f75-4bff-a5f5-ee72ef609c01 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:54.338695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b29bf394-2f75-4bff-a5f5-ee72ef609c01 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:54.360138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abfc6e-08b3-4db6-9244-91abac452318 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:54.361027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abfc6e-08b3-4db6-9244-91abac452318 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.361305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abfc6e-08b3-4db6-9244-91abac452318 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.361640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53abfc6e-08b3-4db6-9244-91abac452318 None admin] PATH_INFO: `/v3/users/a284f7c10ba148eab43b0163d0db6ba7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.362971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abfc6e-08b3-4db6-9244-91abac452318 None admin] RBAC: Authorizing `identity:get_user(user_id=a284f7c10ba148eab43b0163d0db6ba7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:54.364546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53abfc6e-08b3-4db6-9244-91abac452318 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:54.366270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 19/40] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:22:53 2022] GET /identity/v3/users/a284f7c10ba148eab43b0163d0db6ba7 => generated 247 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:54.367057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abfc6e-08b3-4db6-9244-91abac452318 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:54.403696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:54.421450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 22/41] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:22:54.421450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf394-2f75-4bff-a5f5-ee72ef609c01 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:54.481166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53abfc6e-08b3-4db6-9244-91abac452318 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:54.494258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:54.517377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bc48d-c2af-4536-9d9f-b1eff1d840a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:54.517727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29bf394-2f75-4bff-a5f5-ee72ef609c01 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:54.518200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc48d-c2af-4536-9d9f-b1eff1d840a1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.518482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc48d-c2af-4536-9d9f-b1eff1d840a1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.518755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-258bc48d-c2af-4536-9d9f-b1eff1d840a1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.520020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bc48d-c2af-4536-9d9f-b1eff1d840a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:54.521491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-258bc48d-c2af-4536-9d9f-b1eff1d840a1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:54.523113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 20/42] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:22:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:54.523850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bc48d-c2af-4536-9d9f-b1eff1d840a1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:54.555554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd89ae8-7c6c-4ec1-b86b-ff84f8f9b3d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:54.556347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89ae8-7c6c-4ec1-b86b-ff84f8f9b3d7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.556633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89ae8-7c6c-4ec1-b86b-ff84f8f9b3d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.556908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd89ae8-7c6c-4ec1-b86b-ff84f8f9b3d7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.558359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd89ae8-7c6c-4ec1-b86b-ff84f8f9b3d7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:54.559815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd89ae8-7c6c-4ec1-b86b-ff84f8f9b3d7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:54.561447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 23/43] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:22:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:54.562759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd89ae8-7c6c-4ec1-b86b-ff84f8f9b3d7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:54.623842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-258bc48d-c2af-4536-9d9f-b1eff1d840a1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:54.627085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:54.659559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83999bb-f388-4a29-bbf6-af5b87995b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:54.659805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd89ae8-7c6c-4ec1-b86b-ff84f8f9b3d7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:54.660290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83999bb-f388-4a29-bbf6-af5b87995b12 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.660502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83999bb-f388-4a29-bbf6-af5b87995b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.660783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d83999bb-f388-4a29-bbf6-af5b87995b12 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.661568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83999bb-f388-4a29-bbf6-af5b87995b12 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:54.662963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d83999bb-f388-4a29-bbf6-af5b87995b12 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:54.678082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 21/44] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 12 08:22:54 2022] POST /identity/v3/roles => generated 223 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:22:54.678920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83999bb-f388-4a29-bbf6-af5b87995b12 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:54.696071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc532b33-6b00-4912-b297-7c0b68408280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:54.696779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc532b33-6b00-4912-b297-7c0b68408280 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.697067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc532b33-6b00-4912-b297-7c0b68408280 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.697347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc532b33-6b00-4912-b297-7c0b68408280 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.698113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc532b33-6b00-4912-b297-7c0b68408280 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:54.699619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc532b33-6b00-4912-b297-7c0b68408280 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:54.724667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:54.735577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 24/45] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:22:54 2022] POST /identity/v3/projects => generated 312 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:22:54.813301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d83999bb-f388-4a29-bbf6-af5b87995b12 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:54.860881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061abf49-75b0-4a63-bc28-a0ca06a01e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:54.861817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abf49-75b0-4a63-bc28-a0ca06a01e54 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:54.862099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abf49-75b0-4a63-bc28-a0ca06a01e54 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:54.862380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061abf49-75b0-4a63-bc28-a0ca06a01e54 None admin] PATH_INFO: `/v3/domains/default/users/a284f7c10ba148eab43b0163d0db6ba7/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:54.864501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061abf49-75b0-4a63-bc28-a0ca06a01e54 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=a284f7c10ba148eab43b0163d0db6ba7, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:54.866102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-061abf49-75b0-4a63-bc28-a0ca06a01e54 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:54.883119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 22/46] 10.222.0.20 () {58 vars in 1361 bytes} [Tue Jul 12 08:22:54 2022] PUT /identity/v3/domains/default/users/a284f7c10ba148eab43b0163d0db6ba7/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:22:56.790979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f94366-f42e-410a-b401-c2f97da66c12 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:56.791498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f94366-f42e-410a-b401-c2f97da66c12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:56.791600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01f94366-f42e-410a-b401-c2f97da66c12 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:56.792925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 25/47] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:22:56.798830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f060d8-7366-4887-9484-c951d8df3265 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:56.799225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f060d8-7366-4887-9484-c951d8df3265 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:56.799407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f060d8-7366-4887-9484-c951d8df3265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:56.816831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d9f060d8-7366-4887-9484-c951d8df3265 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:56.818375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d9f060d8-7366-4887-9484-c951d8df3265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:56.835332 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:56.885868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 23/48] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:22:56.886254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051df0a-80b3-462b-a0ea-9263fe377b17 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:56.886548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051df0a-80b3-462b-a0ea-9263fe377b17 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:56.886832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2051df0a-80b3-462b-a0ea-9263fe377b17 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:56.888194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 26/49] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:22:56.893690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f2a4-c82e-449e-8b79-59c7e85c9944 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:56.893977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f2a4-c82e-449e-8b79-59c7e85c9944 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:56.894252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a220f2a4-c82e-449e-8b79-59c7e85c9944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:56.908740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051df0a-80b3-462b-a0ea-9263fe377b17 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:56.910210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a220f2a4-c82e-449e-8b79-59c7e85c9944 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:56.911387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a220f2a4-c82e-449e-8b79-59c7e85c9944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:56.976959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 24/50] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:22:57.000640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f2a4-c82e-449e-8b79-59c7e85c9944 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:57.014869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2051df0a-80b3-462b-a0ea-9263fe377b17 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:57.049201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6904dc1-1268-4691-8a22-23f2d9cfba73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:57.049954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6904dc1-1268-4691-8a22-23f2d9cfba73 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:57.050238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6904dc1-1268-4691-8a22-23f2d9cfba73 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:57.050515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6904dc1-1268-4691-8a22-23f2d9cfba73 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:57.051691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6904dc1-1268-4691-8a22-23f2d9cfba73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:57.053159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6904dc1-1268-4691-8a22-23f2d9cfba73 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:57.054819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 27/51] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:22:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:22:57.060131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6904dc1-1268-4691-8a22-23f2d9cfba73 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:57.087657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:57.103892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a220f2a4-c82e-449e-8b79-59c7e85c9944 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:57.129391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:57.141912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddd48e-cc5a-466b-a98b-bb2dfc10ab7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:57.143169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd48e-cc5a-466b-a98b-bb2dfc10ab7e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:57.143451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd48e-cc5a-466b-a98b-bb2dfc10ab7e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:57.143730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ddd48e-cc5a-466b-a98b-bb2dfc10ab7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:57.154110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ddd48e-cc5a-466b-a98b-bb2dfc10ab7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-14ddd48e-cc5a-466b-a98b-bb2dfc10ab7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:22:57.162251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:22:57.163065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:22:57.163827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:22:57.164386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6904dc1-1268-4691-8a22-23f2d9cfba73 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:57.164461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 25/52] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:22:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:22:57.169232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddd48e-cc5a-466b-a98b-bb2dfc10ab7e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:57.196746 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f230dd-63f9-4dd2-a9ed-52341ceb9651 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:57.197407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f230dd-63f9-4dd2-a9ed-52341ceb9651 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:57.197720 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f230dd-63f9-4dd2-a9ed-52341ceb9651 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:57.198000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f230dd-63f9-4dd2-a9ed-52341ceb9651 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:57.198704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f230dd-63f9-4dd2-a9ed-52341ceb9651 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:57.200164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f230dd-63f9-4dd2-a9ed-52341ceb9651 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:57.225931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 28/53] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Jul 12 08:22:57 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:22:57.271952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ddd48e-cc5a-466b-a98b-bb2dfc10ab7e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:57.308254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:57.308855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:57.309141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:57.309449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:57.310213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:22:57.310523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:57.312489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:57.321681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 26/54] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:22:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:22:57.327501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f230dd-63f9-4dd2-a9ed-52341ceb9651 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:57.539440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f230dd-63f9-4dd2-a9ed-52341ceb9651 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:57.556271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:57.574310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1aa3e-c515-44f6-9cde-e7fdf290d384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:57.575115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1aa3e-c515-44f6-9cde-e7fdf290d384 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:57.575394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1aa3e-c515-44f6-9cde-e7fdf290d384 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:57.575665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ce1aa3e-c515-44f6-9cde-e7fdf290d384 None admin] PATH_INFO: `/v3/users/a284f7c10ba148eab43b0163d0db6ba7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:57.577086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1aa3e-c515-44f6-9cde-e7fdf290d384 None admin] RBAC: Authorizing `identity:get_user(user_id=a284f7c10ba148eab43b0163d0db6ba7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:57.579134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ce1aa3e-c515-44f6-9cde-e7fdf290d384 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:57.580750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 29/55] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:22:57 2022] GET /identity/v3/users/a284f7c10ba148eab43b0163d0db6ba7 => generated 247 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:57.586161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:57.596044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:57.684271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cbc077-d48f-47cc-8d40-e8b8d3e89d9a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:57.721186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65c4b0f2-2761-48ec-8f3d-31791377554c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:57.722019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b0f2-2761-48ec-8f3d-31791377554c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:57.722305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b0f2-2761-48ec-8f3d-31791377554c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:57.722585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65c4b0f2-2761-48ec-8f3d-31791377554c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:57.723761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4b0f2-2761-48ec-8f3d-31791377554c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:57.725225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65c4b0f2-2761-48ec-8f3d-31791377554c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:57.726894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 27/56] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:22:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:57.732577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1aa3e-c515-44f6-9cde-e7fdf290d384 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:57.835337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ce1aa3e-c515-44f6-9cde-e7fdf290d384 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:57.869410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02dea719-5544-468f-a0f2-af949df4f4bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:57.870093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dea719-5544-468f-a0f2-af949df4f4bb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:57.870376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dea719-5544-468f-a0f2-af949df4f4bb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:57.870653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02dea719-5544-468f-a0f2-af949df4f4bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:57.871488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dea719-5544-468f-a0f2-af949df4f4bb None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.domain.id=default, user.id=a284f7c10ba148eab43b0163d0db6ba7) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:22:57.871801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dea719-5544-468f-a0f2-af949df4f4bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:57.873232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02dea719-5544-468f-a0f2-af949df4f4bb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:57.882613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 30/57] 10.222.0.20 () {56 vars in 1322 bytes} [Tue Jul 12 08:22:57 2022] GET /identity/v3/role_assignments?user.id=a284f7c10ba148eab43b0163d0db6ba7&scope.domain.id=default&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 530 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:59.269031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d381-a0cf-4b4b-8213-fd245daab260 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:59.269567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d381-a0cf-4b4b-8213-fd245daab260 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:59.269655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d1d381-a0cf-4b4b-8213-fd245daab260 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:59.271003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 28/58] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:22:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:22:59.276588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c23d9d-52df-4fd6-b351-c1328ba880b6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:59.277014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c23d9d-52df-4fd6-b351-c1328ba880b6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:59.277142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c23d9d-52df-4fd6-b351-c1328ba880b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:59.294138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f8c23d9d-52df-4fd6-b351-c1328ba880b6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:22:59.295300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f8c23d9d-52df-4fd6-b351-c1328ba880b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:22:59.339624 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:59.359999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 31/59] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:22:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:22:59.384552 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1d381-a0cf-4b4b-8213-fd245daab260 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:59.460614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:22:59.485725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d1d381-a0cf-4b4b-8213-fd245daab260 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:59.519444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7b1771-2ec2-4fc1-82ac-3061b931182c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:59.520173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1771-2ec2-4fc1-82ac-3061b931182c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:59.520456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1771-2ec2-4fc1-82ac-3061b931182c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:59.520734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7b1771-2ec2-4fc1-82ac-3061b931182c None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:59.521938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b1771-2ec2-4fc1-82ac-3061b931182c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:59.523394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c7b1771-2ec2-4fc1-82ac-3061b931182c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:59.525264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 29/60] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:22:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:22:59.530727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c23d9d-52df-4fd6-b351-c1328ba880b6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:22:59.629577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c23d9d-52df-4fd6-b351-c1328ba880b6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:22:59.662218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078ae5d9-dcae-4669-bccc-7de2c293dbff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:22:59.662876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ae5d9-dcae-4669-bccc-7de2c293dbff None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:22:59.663160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ae5d9-dcae-4669-bccc-7de2c293dbff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:22:59.663439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078ae5d9-dcae-4669-bccc-7de2c293dbff None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:22:59.664155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ae5d9-dcae-4669-bccc-7de2c293dbff None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:22:59.665619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078ae5d9-dcae-4669-bccc-7de2c293dbff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:22:59.690671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 32/61] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:22:59 2022] POST /identity/v3/users => generated 275 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:02.802879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465349f-6ab7-4e77-a78d-6dae29d43071 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:02.803750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465349f-6ab7-4e77-a78d-6dae29d43071 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:02.804175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b465349f-6ab7-4e77-a78d-6dae29d43071 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:02.805727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 30/62] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:02 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:02.811055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcad2a-cfc9-4511-a071-42220119a425 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:02.811911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcad2a-cfc9-4511-a071-42220119a425 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:02.812422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fcad2a-cfc9-4511-a071-42220119a425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:02.833442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-65fcad2a-cfc9-4511-a071-42220119a425 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:02.833442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-65fcad2a-cfc9-4511-a071-42220119a425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:02.869356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:02.923334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 33/63] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:02.950141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465349f-6ab7-4e77-a78d-6dae29d43071 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.016964 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37f611-b8b5-409b-a751-faec624dbc02 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.017509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37f611-b8b5-409b-a751-faec624dbc02 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.018028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad37f611-b8b5-409b-a751-faec624dbc02 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.019664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 34/64] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:03 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:03.028425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cca43-fde9-4f06-845f-b50dae807ded None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.028956 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cca43-fde9-4f06-845f-b50dae807ded None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.029429 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab2cca43-fde9-4f06-845f-b50dae807ded None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.064633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ab2cca43-fde9-4f06-845f-b50dae807ded None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:03.066071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ab2cca43-fde9-4f06-845f-b50dae807ded None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:03.078422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b465349f-6ab7-4e77-a78d-6dae29d43071 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.120590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649316c3-bf36-49f6-8c1b-bcd92cd21ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.121390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649316c3-bf36-49f6-8c1b-bcd92cd21ffa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.121697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649316c3-bf36-49f6-8c1b-bcd92cd21ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.121974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649316c3-bf36-49f6-8c1b-bcd92cd21ffa None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.142295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649316c3-bf36-49f6-8c1b-bcd92cd21ffa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-649316c3-bf36-49f6-8c1b-bcd92cd21ffa None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:03.158848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:03.159761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:03.160517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:03.162748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 31/65] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:03.169878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649316c3-bf36-49f6-8c1b-bcd92cd21ffa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.175602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:03.207295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 35/66] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 08:23:03.209060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f38ab-281d-4a68-abab-8623ceca2c7f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.209606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f38ab-281d-4a68-abab-8623ceca2c7f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.210079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef8f38ab-281d-4a68-abab-8623ceca2c7f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.211804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 36/67] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:03.230432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b48a7-20b7-4363-84eb-c347e842ec60 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.231025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b48a7-20b7-4363-84eb-c347e842ec60 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.231522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378b48a7-20b7-4363-84eb-c347e842ec60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.249771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-378b48a7-20b7-4363-84eb-c347e842ec60 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:03.251046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-378b48a7-20b7-4363-84eb-c347e842ec60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:03.303991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649316c3-bf36-49f6-8c1b-bcd92cd21ffa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.327316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 37/68] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:03.328087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b48a7-20b7-4363-84eb-c347e842ec60 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.341445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6596da7-4c7f-404c-a92c-7f5020d1266b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.342438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596da7-4c7f-404c-a92c-7f5020d1266b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.343450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596da7-4c7f-404c-a92c-7f5020d1266b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.343937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6596da7-4c7f-404c-a92c-7f5020d1266b None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.344985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6596da7-4c7f-404c-a92c-7f5020d1266b None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:03.345515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6596da7-4c7f-404c-a92c-7f5020d1266b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:03.347207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6596da7-4c7f-404c-a92c-7f5020d1266b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:03.356859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 32/69] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:03 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:03.359120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9c00-4e20-4c90-834e-e0e90d727a19 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.359636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9c00-4e20-4c90-834e-e0e90d727a19 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.360113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfd9c00-4e20-4c90-834e-e0e90d727a19 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.361956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 33/70] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:03.362908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9c00-4e20-4c90-834e-e0e90d727a19 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.364760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:03.436412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:03.449247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378b48a7-20b7-4363-84eb-c347e842ec60 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.477479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfd9c00-4e20-4c90-834e-e0e90d727a19 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.485875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1f4b940-f772-4cd5-9c69-e9460cf63744 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.486665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b940-f772-4cd5-9c69-e9460cf63744 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.486944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b940-f772-4cd5-9c69-e9460cf63744 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.487214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1f4b940-f772-4cd5-9c69-e9460cf63744 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.498228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1f4b940-f772-4cd5-9c69-e9460cf63744 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e1f4b940-f772-4cd5-9c69-e9460cf63744 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:03.507366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:03.508386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:03.509143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 38/71] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:03 2022] GET /identity/v3/roles/admin => generated 83 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:03.511109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e6a14-81b7-4f7b-97e5-f7b233c3016a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.511405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e6a14-81b7-4f7b-97e5-f7b233c3016a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.511686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6e6a14-81b7-4f7b-97e5-f7b233c3016a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.513585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89115061-6f1b-4314-bdf0-7a3ad7df9ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.514390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89115061-6f1b-4314-bdf0-7a3ad7df9ffb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.514678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89115061-6f1b-4314-bdf0-7a3ad7df9ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.515489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89115061-6f1b-4314-bdf0-7a3ad7df9ffb None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.526912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89115061-6f1b-4314-bdf0-7a3ad7df9ffb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:03.528507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-df6e6a14-81b7-4f7b-97e5-f7b233c3016a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:03.529716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df6e6a14-81b7-4f7b-97e5-f7b233c3016a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-89115061-6f1b-4314-bdf0-7a3ad7df9ffb None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:03.535648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:03.536780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 34/72] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:03 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:03.538051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89115061-6f1b-4314-bdf0-7a3ad7df9ffb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.600500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 39/73] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:03.601869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e174e-26a7-4904-bbef-332747bd012f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.602161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e174e-26a7-4904-bbef-332747bd012f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.602438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33e174e-26a7-4904-bbef-332747bd012f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.603853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 40/74] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:03.608279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e174e-26a7-4904-bbef-332747bd012f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.628009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:03.638937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89115061-6f1b-4314-bdf0-7a3ad7df9ffb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.662201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:03.673829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68035fb-962a-49ff-9ab5-48e89f1b4daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.674696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68035fb-962a-49ff-9ab5-48e89f1b4daf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.674975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68035fb-962a-49ff-9ab5-48e89f1b4daf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.675248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68035fb-962a-49ff-9ab5-48e89f1b4daf None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.689649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68035fb-962a-49ff-9ab5-48e89f1b4daf None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:03.691109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68035fb-962a-49ff-9ab5-48e89f1b4daf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:03.692820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 35/75] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:03 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:03.693603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68035fb-962a-49ff-9ab5-48e89f1b4daf None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.713190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33e174e-26a7-4904-bbef-332747bd012f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.746258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af15ceab-71a4-4306-b25d-da6a595f2e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.746921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ceab-71a4-4306-b25d-da6a595f2e1b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.747200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ceab-71a4-4306-b25d-da6a595f2e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.747471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af15ceab-71a4-4306-b25d-da6a595f2e1b None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.748212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15ceab-71a4-4306-b25d-da6a595f2e1b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:03.748515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15ceab-71a4-4306-b25d-da6a595f2e1b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:03.750618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af15ceab-71a4-4306-b25d-da6a595f2e1b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:03.761470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 41/76] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:03 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:03.761470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7e2e4-565c-499d-9b79-3900a1af6626 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.761470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7e2e4-565c-499d-9b79-3900a1af6626 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.761470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf7e2e4-565c-499d-9b79-3900a1af6626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.775813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2bf7e2e4-565c-499d-9b79-3900a1af6626 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:03.776987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2bf7e2e4-565c-499d-9b79-3900a1af6626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:03.800308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68035fb-962a-49ff-9ab5-48e89f1b4daf None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.834803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.835461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.835741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.836017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.836761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:03.837062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:03.838477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:03.844661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 42/77] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:03.845297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7e2e4-565c-499d-9b79-3900a1af6626 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.850696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 36/78] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:03 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:03.850696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:03.858206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:03.908640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:03.951274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf7e2e4-565c-499d-9b79-3900a1af6626 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.961750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2e4b2e-5f68-4ba3-94ac-914e83ff242c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:03.986747 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbda9fc-aed6-4755-a34c-fd5e284ed26e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.987546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda9fc-aed6-4755-a34c-fd5e284ed26e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.987836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda9fc-aed6-4755-a34c-fd5e284ed26e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.988344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cbda9fc-aed6-4755-a34c-fd5e284ed26e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.995534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccf82e-636a-4c99-9bef-8777b6cf943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:03.996179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccf82e-636a-4c99-9bef-8777b6cf943c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:03.996469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccf82e-636a-4c99-9bef-8777b6cf943c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:03.996753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ccf82e-636a-4c99-9bef-8777b6cf943c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:03.997879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cbda9fc-aed6-4755-a34c-fd5e284ed26e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7cbda9fc-aed6-4755-a34c-fd5e284ed26e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:04.006840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:04.007686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:04.008614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 43/79] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:03 2022] GET /identity/v3/roles/member => generated 84 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:04.009485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbda9fc-aed6-4755-a34c-fd5e284ed26e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.067482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccf82e-636a-4c99-9bef-8777b6cf943c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.068970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ccf82e-636a-4c99-9bef-8777b6cf943c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.074412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.107954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cbda9fc-aed6-4755-a34c-fd5e284ed26e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.113406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.147683 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e36d-c089-486b-b5d9-5905d1d57431 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.148651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e36d-c089-486b-b5d9-5905d1d57431 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.148940 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e36d-c089-486b-b5d9-5905d1d57431 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.149214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be5e36d-c089-486b-b5d9-5905d1d57431 None admin] PATH_INFO: `/v3/users/a284f7c10ba148eab43b0163d0db6ba7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.152131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5e36d-c089-486b-b5d9-5905d1d57431 None admin] RBAC: Authorizing `identity:get_user(user_id=a284f7c10ba148eab43b0163d0db6ba7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.153619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be5e36d-c089-486b-b5d9-5905d1d57431 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.155247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 44/80] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/users/a284f7c10ba148eab43b0163d0db6ba7 => generated 247 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:04.156125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e36d-c089-486b-b5d9-5905d1d57431 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.170460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 37/81] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:03 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:04.171315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccf82e-636a-4c99-9bef-8777b6cf943c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.254878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be5e36d-c089-486b-b5d9-5905d1d57431 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.268113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ccf82e-636a-4c99-9bef-8777b6cf943c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.287538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623ee2-12b3-4c60-b4ed-4fb127fc7505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.288400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623ee2-12b3-4c60-b4ed-4fb127fc7505 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.288683 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623ee2-12b3-4c60-b4ed-4fb127fc7505 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.288960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52623ee2-12b3-4c60-b4ed-4fb127fc7505 None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.290158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52623ee2-12b3-4c60-b4ed-4fb127fc7505 None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.291586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52623ee2-12b3-4c60-b4ed-4fb127fc7505 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.293237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 45/82] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:04.294028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623ee2-12b3-4c60-b4ed-4fb127fc7505 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.298044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.311095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1a6c-2aae-4626-9913-5f6b11348a31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.312491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1a6c-2aae-4626-9913-5f6b11348a31 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.312770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1a6c-2aae-4626-9913-5f6b11348a31 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.313043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fa1a6c-2aae-4626-9913-5f6b11348a31 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.314241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa1a6c-2aae-4626-9913-5f6b11348a31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.315685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fa1a6c-2aae-4626-9913-5f6b11348a31 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.317291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 38/83] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:04.318074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1a6c-2aae-4626-9913-5f6b11348a31 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.332308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.395579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52623ee2-12b3-4c60-b4ed-4fb127fc7505 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.417055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fa1a6c-2aae-4626-9913-5f6b11348a31 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.429714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.430382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.430671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.430950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.431700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:04.432008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.433379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.441367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 46/84] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:04.442173 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.457679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9dd5-cfb1-402d-93b3-4e4f5d5a0b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.458323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9dd5-cfb1-402d-93b3-4e4f5d5a0b44 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.458604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9dd5-cfb1-402d-93b3-4e4f5d5a0b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.458880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-097d9dd5-cfb1-402d-93b3-4e4f5d5a0b44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.507219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.525904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d9dd5-cfb1-402d-93b3-4e4f5d5a0b44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.527375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-097d9dd5-cfb1-402d-93b3-4e4f5d5a0b44 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.541932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.543201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887c7bfb-9a8a-4831-9e9a-bbb0948ae3b3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.576082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaf87a-e92e-4b47-9469-d29dca2c34a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.576928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaf87a-e92e-4b47-9469-d29dca2c34a8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.577749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaf87a-e92e-4b47-9469-d29dca2c34a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.578034 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cdaf87a-e92e-4b47-9469-d29dca2c34a8 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.579213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaf87a-e92e-4b47-9469-d29dca2c34a8 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.580661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cdaf87a-e92e-4b47-9469-d29dca2c34a8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.582386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 47/85] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:04.583146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaf87a-e92e-4b47-9469-d29dca2c34a8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.631019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 39/86] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:04.631019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9dd5-cfb1-402d-93b3-4e4f5d5a0b44 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.688126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cdaf87a-e92e-4b47-9469-d29dca2c34a8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.720672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715a4d5-9dbf-4867-b4a6-40efbadee218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.721318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a4d5-9dbf-4867-b4a6-40efbadee218 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.721629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a4d5-9dbf-4867-b4a6-40efbadee218 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.721906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715a4d5-9dbf-4867-b4a6-40efbadee218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.723062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-097d9dd5-cfb1-402d-93b3-4e4f5d5a0b44 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.724697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.736642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.757583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08faca-083d-4271-b213-fcb9ebd716c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.758245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08faca-083d-4271-b213-fcb9ebd716c7 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.758528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08faca-083d-4271-b213-fcb9ebd716c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.758806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e08faca-083d-4271-b213-fcb9ebd716c7 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.759520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08faca-083d-4271-b213-fcb9ebd716c7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.760957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e08faca-083d-4271-b213-fcb9ebd716c7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.787338 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 40/87] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:04 2022] POST /identity/v3/users => generated 289 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:04.788150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08faca-083d-4271-b213-fcb9ebd716c7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.802487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715a4d5-9dbf-4867-b4a6-40efbadee218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.804026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715a4d5-9dbf-4867-b4a6-40efbadee218 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.903283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e08faca-083d-4271-b213-fcb9ebd716c7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:04.920733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 48/88] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:04.921692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715a4d5-9dbf-4867-b4a6-40efbadee218 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.951406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b68bb3-6730-45af-8663-70e44d7e22ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:04.952248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b68bb3-6730-45af-8663-70e44d7e22ad None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:04.952610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b68bb3-6730-45af-8663-70e44d7e22ad None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:04.952854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b68bb3-6730-45af-8663-70e44d7e22ad None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:04.954929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b68bb3-6730-45af-8663-70e44d7e22ad None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:04.956330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17b68bb3-6730-45af-8663-70e44d7e22ad None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:04.958150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 41/89] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:04.961449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b68bb3-6730-45af-8663-70e44d7e22ad None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:04.962110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:04.997071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:05.048010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715a4d5-9dbf-4867-b4a6-40efbadee218 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:05.089655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b68bb3-6730-45af-8663-70e44d7e22ad None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:05.093099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:05.093799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:05.094107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:05.094365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:05.095205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] RBAC: Adding query filter params (role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=f89be6274838409da0aafbfa44983f83, user.id=6f25eff4460b401a9650f91f232be225) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:05.095515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:05.096981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:05.102930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 49/90] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/role_assignments?user.id=6f25eff4460b401a9650f91f232be225&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=672aed7af8e9436a801cd1eca8806cce => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:05.103755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:05.135452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d841d-dbb1-4a7e-b112-2b13aa53caa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:05.136347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d841d-dbb1-4a7e-b112-2b13aa53caa5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:05.136630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d841d-dbb1-4a7e-b112-2b13aa53caa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:05.137495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9d841d-dbb1-4a7e-b112-2b13aa53caa5 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:05.138573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d841d-dbb1-4a7e-b112-2b13aa53caa5 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:05.141620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9d841d-dbb1-4a7e-b112-2b13aa53caa5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:05.143724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 42/91] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:04 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:05.145022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d841d-dbb1-4a7e-b112-2b13aa53caa5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:05.229535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:05.235454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fb847d-1432-4498-bbb9-5613e85d148e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:05.275746 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4a08-a928-42d3-aa67-df7113ac9e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:05.277589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4a08-a928-42d3-aa67-df7113ac9e5b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:05.278356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4a08-a928-42d3-aa67-df7113ac9e5b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:05.278838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08b4a08-a928-42d3-aa67-df7113ac9e5b None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:05.281383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b4a08-a928-42d3-aa67-df7113ac9e5b None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:05.283693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08b4a08-a928-42d3-aa67-df7113ac9e5b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:05.284010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9d841d-dbb1-4a7e-b112-2b13aa53caa5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:05.286071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 50/92] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:05 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:05.286413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:05.288180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4a08-a928-42d3-aa67-df7113ac9e5b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:05.348646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c79df-4ee7-47ac-b1f2-1b8e58816650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:05.349311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c79df-4ee7-47ac-b1f2-1b8e58816650 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:05.349648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c79df-4ee7-47ac-b1f2-1b8e58816650 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:05.349883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0c79df-4ee7-47ac-b1f2-1b8e58816650 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:05.428984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08b4a08-a928-42d3-aa67-df7113ac9e5b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:05.479296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:05.480393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:05.481029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:05.481872 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c79df-4ee7-47ac-b1f2-1b8e58816650 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:05.482371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:05.483435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=f89be6274838409da0aafbfa44983f83, user.id=a284f7c10ba148eab43b0163d0db6ba7) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:05.485803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0c79df-4ee7-47ac-b1f2-1b8e58816650 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:05.489904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:05.491387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:05.511255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 51/93] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:05 2022] GET /identity/v3/role_assignments?user.id=a284f7c10ba148eab43b0163d0db6ba7&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:05.512498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:05.578854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:05.682083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 43/94] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:05.688283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c79df-4ee7-47ac-b1f2-1b8e58816650 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:05.705471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:05.790877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0194c1f-8066-472e-a490-2961ac9532b9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:05.851455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:05.852188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:05.852480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:05.852759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:05.853631 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] RBAC: Adding query filter params (role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=f89be6274838409da0aafbfa44983f83, user.id=6f25eff4460b401a9650f91f232be225) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:05.853952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:05.855786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:05.866037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 52/95] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:05 2022] GET /identity/v3/role_assignments?user.id=6f25eff4460b401a9650f91f232be225&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 259 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:05.883362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0c79df-4ee7-47ac-b1f2-1b8e58816650 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:05.955778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f13e89-57eb-4e87-98a6-74b009f5456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:05.956692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f13e89-57eb-4e87-98a6-74b009f5456c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:05.956978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f13e89-57eb-4e87-98a6-74b009f5456c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:05.957262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f13e89-57eb-4e87-98a6-74b009f5456c None admin] PATH_INFO: `/v3/projects/073fd0eb4bfe4a7ea9315dd77f5df195` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:05.962186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f13e89-57eb-4e87-98a6-74b009f5456c None admin] RBAC: Authorizing `identity:get_project(project_id=073fd0eb4bfe4a7ea9315dd77f5df195)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:05.963656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f13e89-57eb-4e87-98a6-74b009f5456c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:05.965792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 44/96] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:05 2022] GET /identity/v3/projects/073fd0eb4bfe4a7ea9315dd77f5df195 => generated 312 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:05.971271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:06.127253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:06.135638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e385a9-9f65-4708-ab89-d5b685753368 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:06.180813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9e1fc0-9cbe-4e0e-8e84-e98f20c3a52d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:06.181738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e1fc0-9cbe-4e0e-8e84-e98f20c3a52d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:06.182221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e1fc0-9cbe-4e0e-8e84-e98f20c3a52d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:06.182639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9e1fc0-9cbe-4e0e-8e84-e98f20c3a52d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:06.183706 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e1fc0-9cbe-4e0e-8e84-e98f20c3a52d None admin] RBAC: Adding query filter params (role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=073fd0eb4bfe4a7ea9315dd77f5df195, user.id=6f25eff4460b401a9650f91f232be225) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:06.184158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e1fc0-9cbe-4e0e-8e84-e98f20c3a52d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:06.185778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d9e1fc0-9cbe-4e0e-8e84-e98f20c3a52d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:06.194762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 53/97] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:05 2022] GET /identity/v3/role_assignments?user.id=6f25eff4460b401a9650f91f232be225&scope.project.id=073fd0eb4bfe4a7ea9315dd77f5df195&role.id=672aed7af8e9436a801cd1eca8806cce => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:07.424694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f69c-ac74-4ac9-a33a-bdaddf45e2d3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:07.425717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f69c-ac74-4ac9-a33a-bdaddf45e2d3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:07.426197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b10f69c-ac74-4ac9-a33a-bdaddf45e2d3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:07.427814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 45/98] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:07.433701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7575c8-8efa-4914-83b2-dc891b9bd31e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:07.434646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7575c8-8efa-4914-83b2-dc891b9bd31e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:07.435135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7575c8-8efa-4914-83b2-dc891b9bd31e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:07.458494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fb7575c8-8efa-4914-83b2-dc891b9bd31e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:07.459694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fb7575c8-8efa-4914-83b2-dc891b9bd31e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:07.543909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 54/99] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:07.580386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f69c-ac74-4ac9-a33a-bdaddf45e2d3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:07.676943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:07.720692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b10f69c-ac74-4ac9-a33a-bdaddf45e2d3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:07.775757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4232f9a6-0f2c-40c7-b864-6b7d71da025a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:07.776903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f9a6-0f2c-40c7-b864-6b7d71da025a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:07.777434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f9a6-0f2c-40c7-b864-6b7d71da025a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:07.777912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232f9a6-0f2c-40c7-b864-6b7d71da025a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:07.793560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4232f9a6-0f2c-40c7-b864-6b7d71da025a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4232f9a6-0f2c-40c7-b864-6b7d71da025a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:07.804247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:07.805147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:07.805943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:07.813546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 46/100] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:07.818547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7575c8-8efa-4914-83b2-dc891b9bd31e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:07.898235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb7a0-1f59-4942-b801-eeabaed58f8e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:07.898845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb7a0-1f59-4942-b801-eeabaed58f8e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:07.899327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31bb7a0-1f59-4942-b801-eeabaed58f8e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:07.901185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 47/101] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:07.907213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310be688-226a-4ad0-9225-952579c82792 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:07.907745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310be688-226a-4ad0-9225-952579c82792 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:07.908249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310be688-226a-4ad0-9225-952579c82792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:07.942494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-310be688-226a-4ad0-9225-952579c82792 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:07.944044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-310be688-226a-4ad0-9225-952579c82792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:07.976566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:08.000205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7575c8-8efa-4914-83b2-dc891b9bd31e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:08.067345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ad3d3d-9be9-4a11-9ae7-e676e14fa606 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:08.068022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3d3d-9be9-4a11-9ae7-e676e14fa606 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.068307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3d3d-9be9-4a11-9ae7-e676e14fa606 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.068584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ad3d3d-9be9-4a11-9ae7-e676e14fa606 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.069339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3d3d-9be9-4a11-9ae7-e676e14fa606 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:08.069671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3d3d-9be9-4a11-9ae7-e676e14fa606 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:08.071048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ad3d3d-9be9-4a11-9ae7-e676e14fa606 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:08.085798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 48/102] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:08.087188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa294e-0442-4d0c-b70a-a6eb6b7c4bb5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.087542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa294e-0442-4d0c-b70a-a6eb6b7c4bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.087824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6fa294e-0442-4d0c-b70a-a6eb6b7c4bb5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.093738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 49/103] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:08 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:08.096055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 55/104] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:08.103118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa294e-0442-4d0c-b70a-a6eb6b7c4bb5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:08.115569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742dc1-f547-4cc9-804e-efbcf350e46b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.115873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742dc1-f547-4cc9-804e-efbcf350e46b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.116106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8742dc1-f547-4cc9-804e-efbcf350e46b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.159222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c8742dc1-f547-4cc9-804e-efbcf350e46b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:08.160497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8742dc1-f547-4cc9-804e-efbcf350e46b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:08.237908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:08.292974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6fa294e-0442-4d0c-b70a-a6eb6b7c4bb5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:08.307807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 56/105] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:08.308686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742dc1-f547-4cc9-804e-efbcf350e46b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:08.344669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b55da3-44e3-489c-911c-6871b274db67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:08.345962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b55da3-44e3-489c-911c-6871b274db67 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.346451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b55da3-44e3-489c-911c-6871b274db67 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.346926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b55da3-44e3-489c-911c-6871b274db67 None admin] PATH_INFO: `/v3/users/b6b0ab19bfee4341bd17dc571217db61` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.362984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b55da3-44e3-489c-911c-6871b274db67 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b0ab19bfee4341bd17dc571217db61)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:08.364811 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b55da3-44e3-489c-911c-6871b274db67 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:08.366813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 50/106] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:08 2022] GET /identity/v3/users/b6b0ab19bfee4341bd17dc571217db61 => generated 289 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:08.367857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b55da3-44e3-489c-911c-6871b274db67 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:08.488392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:08.503080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b55da3-44e3-489c-911c-6871b274db67 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:08.525805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:08.542597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2438997-71a9-45a5-9871-9650fa236087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:08.543627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438997-71a9-45a5-9871-9650fa236087 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.544057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438997-71a9-45a5-9871-9650fa236087 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.544506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2438997-71a9-45a5-9871-9650fa236087 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.555561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8742dc1-f547-4cc9-804e-efbcf350e46b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:08.556820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2438997-71a9-45a5-9871-9650fa236087 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b2438997-71a9-45a5-9871-9650fa236087 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:08.565085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:08.566207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:08.567156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:08.573624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 51/107] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:08.574614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2438997-71a9-45a5-9871-9650fa236087 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:08.634132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc28d8-98c3-456c-949f-700d3d6ca139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:08.635158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc28d8-98c3-456c-949f-700d3d6ca139 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.635516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc28d8-98c3-456c-949f-700d3d6ca139 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.635868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1bc28d8-98c3-456c-949f-700d3d6ca139 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.637128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc28d8-98c3-456c-949f-700d3d6ca139 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:08.638704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1bc28d8-98c3-456c-949f-700d3d6ca139 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:08.649440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 57/108] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 332 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:08.650840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc28d8-98c3-456c-949f-700d3d6ca139 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:08.681000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2438997-71a9-45a5-9871-9650fa236087 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:08.715709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e59149fd-e108-4689-bd28-a8d228c801d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:08.716661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59149fd-e108-4689-bd28-a8d228c801d8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.717166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59149fd-e108-4689-bd28-a8d228c801d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.717695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e59149fd-e108-4689-bd28-a8d228c801d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.778825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:08.801401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59149fd-e108-4689-bd28-a8d228c801d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:08.803660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e59149fd-e108-4689-bd28-a8d228c801d8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:08.819458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1bc28d8-98c3-456c-949f-700d3d6ca139 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:08.865405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:08.866500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.866895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.867279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.868532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:08.868956 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:08.870477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:08.880132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 58/109] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:08.880945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:08.897676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:08.928630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 52/110] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:08.929905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e44fae-9e10-4367-b008-57b5c329ab97 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.930195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e44fae-9e10-4367-b008-57b5c329ab97 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.930472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e44fae-9e10-4367-b008-57b5c329ab97 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.931896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 53/111] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:08.932874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3a78-b243-48b7-90ec-93556078de57 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:08.933146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3a78-b243-48b7-90ec-93556078de57 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:08.933734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962b3a78-b243-48b7-90ec-93556078de57 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:08.934715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 54/112] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:08 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:08.935264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3a78-b243-48b7-90ec-93556078de57 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:08.999525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3738c1a-c5aa-420f-9552-dad246df7186 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.023011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:09.035152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7688b-3908-47de-8116-06e736ac5daf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.035738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7688b-3908-47de-8116-06e736ac5daf None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.036021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7688b-3908-47de-8116-06e736ac5daf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.036295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6e7688b-3908-47de-8116-06e736ac5daf None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.037011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7688b-3908-47de-8116-06e736ac5daf None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:09.038504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6e7688b-3908-47de-8116-06e736ac5daf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:09.044380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962b3a78-b243-48b7-90ec-93556078de57 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.066919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 59/113] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:23:08 2022] POST /identity/v3/projects => generated 302 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:09.066919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7688b-3908-47de-8116-06e736ac5daf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:09.083550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a49e9b-da86-4860-8ca2-b7aa76c18339 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.084464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49e9b-da86-4860-8ca2-b7aa76c18339 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.084752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49e9b-da86-4860-8ca2-b7aa76c18339 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.085032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a49e9b-da86-4860-8ca2-b7aa76c18339 None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.086360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a49e9b-da86-4860-8ca2-b7aa76c18339 None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:09.088541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a49e9b-da86-4860-8ca2-b7aa76c18339 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:09.090797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 55/114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:08 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:09.094970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b828d-6652-4bad-bc9d-4c69c11c99ff None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.095313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b828d-6652-4bad-bc9d-4c69c11c99ff None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.095597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9b828d-6652-4bad-bc9d-4c69c11c99ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.119848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3f9b828d-6652-4bad-bc9d-4c69c11c99ff None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:09.121300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3f9b828d-6652-4bad-bc9d-4c69c11c99ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:09.169433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:09.213163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6e7688b-3908-47de-8116-06e736ac5daf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.219535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 56/115] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:09.221054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f17ad-7e30-41db-9b76-d2da76a130e9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.221350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f17ad-7e30-41db-9b76-d2da76a130e9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.221703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264f17ad-7e30-41db-9b76-d2da76a130e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.248595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-264f17ad-7e30-41db-9b76-d2da76a130e9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:09.250447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-264f17ad-7e30-41db-9b76-d2da76a130e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:09.271582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51e1ef-a90f-4a4b-8365-35d5e88c0160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.272444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51e1ef-a90f-4a4b-8365-35d5e88c0160 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.272730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51e1ef-a90f-4a4b-8365-35d5e88c0160 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.273009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e51e1ef-a90f-4a4b-8365-35d5e88c0160 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.275383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51e1ef-a90f-4a4b-8365-35d5e88c0160 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:09.276990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e51e1ef-a90f-4a4b-8365-35d5e88c0160 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:09.278748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 60/116] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:09 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:09.279730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51e1ef-a90f-4a4b-8365-35d5e88c0160 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:09.332641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 57/117] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:09.333240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f17ad-7e30-41db-9b76-d2da76a130e9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:09.345907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:09.390046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e51e1ef-a90f-4a4b-8365-35d5e88c0160 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.425443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:09.433008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612969-3be2-4ace-ac61-1ad29601cb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.433910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612969-3be2-4ace-ac61-1ad29601cb01 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.434194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612969-3be2-4ace-ac61-1ad29601cb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.434471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c612969-3be2-4ace-ac61-1ad29601cb01 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.435666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c612969-3be2-4ace-ac61-1ad29601cb01 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:09.437960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c612969-3be2-4ace-ac61-1ad29601cb01 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:09.439703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 61/118] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:09 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:09.440467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612969-3be2-4ace-ac61-1ad29601cb01 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:09.463081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264f17ad-7e30-41db-9b76-d2da76a130e9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.501136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c457cf-accd-4f1f-b588-8f2ef101bd79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.502248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c457cf-accd-4f1f-b588-8f2ef101bd79 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.502532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c457cf-accd-4f1f-b588-8f2ef101bd79 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.502809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c457cf-accd-4f1f-b588-8f2ef101bd79 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.514136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c457cf-accd-4f1f-b588-8f2ef101bd79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-67c457cf-accd-4f1f-b588-8f2ef101bd79 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:09.522448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:09.523286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:09.524038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 58/119] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:09 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:09.525584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bfdb-d59d-473a-8d0f-3a74b8f16acb None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.525764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bfdb-d59d-473a-8d0f-3a74b8f16acb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.526035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e42bfdb-d59d-473a-8d0f-3a74b8f16acb None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.527468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 59/120] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:09.530196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42bfdb-d59d-473a-8d0f-3a74b8f16acb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:09.557200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c612969-3be2-4ace-ac61-1ad29601cb01 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.596505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.597080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.597367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.597679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.598547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] RBAC: Adding query filter params (role.id=4b79664b5ed44a6f9ce2785fe2729fa1, scope.project.id=f89be6274838409da0aafbfa44983f83, user.id=b6b0ab19bfee4341bd17dc571217db61) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:09.598868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:09.600315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:09.603746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:09.606827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 62/121] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:09 2022] GET /identity/v3/role_assignments?user.id=b6b0ab19bfee4341bd17dc571217db61&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=4b79664b5ed44a6f9ce2785fe2729fa1 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:09.607617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:09.658132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e42bfdb-d59d-473a-8d0f-3a74b8f16acb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.702239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f635-1ab7-49fe-809e-3ffd50578cdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.703454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f635-1ab7-49fe-809e-3ffd50578cdc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.703615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:09.704141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f635-1ab7-49fe-809e-3ffd50578cdc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.704596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e9f635-1ab7-49fe-809e-3ffd50578cdc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.720382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e9f635-1ab7-49fe-809e-3ffd50578cdc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-96e9f635-1ab7-49fe-809e-3ffd50578cdc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:09.730651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:09.731566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:09.732446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:09.735402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 60/122] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:09 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:09.741617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f635-1ab7-49fe-809e-3ffd50578cdc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:09.753628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a293f4ab-5aa5-4860-8857-dba96433145c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.818157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7991226d-dbab-409b-a6fa-2b294be7ff84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.820036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991226d-dbab-409b-a6fa-2b294be7ff84 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.820469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991226d-dbab-409b-a6fa-2b294be7ff84 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.821121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7991226d-dbab-409b-a6fa-2b294be7ff84 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83/users/6f25eff4460b401a9650f91f232be225/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.824224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991226d-dbab-409b-a6fa-2b294be7ff84 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89be6274838409da0aafbfa44983f83, user_id=6f25eff4460b401a9650f91f232be225, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:09.826016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7991226d-dbab-409b-a6fa-2b294be7ff84 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:09.846407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 63/123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:09 2022] PUT /identity/v3/projects/f89be6274838409da0aafbfa44983f83/users/6f25eff4460b401a9650f91f232be225/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:09.848365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4f39-80af-427d-bfcc-1a467c834f0a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.848810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4f39-80af-427d-bfcc-1a467c834f0a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.849509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd9b4f39-80af-427d-bfcc-1a467c834f0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.868757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e9f635-1ab7-49fe-809e-3ffd50578cdc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:09.869492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cd9b4f39-80af-427d-bfcc-1a467c834f0a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:09.870857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cd9b4f39-80af-427d-bfcc-1a467c834f0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:09.900850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:09.912073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:09.912949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:09.914093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:09.914093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:09.914735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:09.915298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:09.917064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:09.929071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 61/124] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:09 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:09.930149 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:09.950609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 64/125] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:09.951781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4f39-80af-427d-bfcc-1a467c834f0a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.010463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:10.066257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd9b4f39-80af-427d-bfcc-1a467c834f0a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:10.070721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df2467-207f-4b3c-b2d4-a10470bd3046 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:10.105127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65987d-7dda-4393-87e2-a8d61b751a6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:10.106559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65987d-7dda-4393-87e2-a8d61b751a6a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:10.107118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65987d-7dda-4393-87e2-a8d61b751a6a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:10.107693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f65987d-7dda-4393-87e2-a8d61b751a6a None admin] PATH_INFO: `/v3/users/a284f7c10ba148eab43b0163d0db6ba7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:10.108213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:10.109012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:10.109368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:10.109811 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:10.110077 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65987d-7dda-4393-87e2-a8d61b751a6a None admin] RBAC: Authorizing `identity:get_user(user_id=a284f7c10ba148eab43b0163d0db6ba7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:10.110578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:10.110890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:10.112200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f65987d-7dda-4393-87e2-a8d61b751a6a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:10.112318 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:10.114573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 65/126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:09 2022] GET /identity/v3/users/a284f7c10ba148eab43b0163d0db6ba7 => generated 247 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:10.115613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65987d-7dda-4393-87e2-a8d61b751a6a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.122105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 62/127] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:09 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:10.128360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.205436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:10.259514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f65987d-7dda-4393-87e2-a8d61b751a6a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:10.269135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca99c860-4e12-4873-b49b-bcffff0f2e8b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:10.285822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:10.297747 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9a36-7c62-4ccc-8583-afd86c837e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:10.298847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9a36-7c62-4ccc-8583-afd86c837e3f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:10.299353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9a36-7c62-4ccc-8583-afd86c837e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:10.299823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857f9a36-7c62-4ccc-8583-afd86c837e3f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:10.315942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d322705-f3ae-4a59-81f0-c62ba8981d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:10.317134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322705-f3ae-4a59-81f0-c62ba8981d2e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:10.318437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857f9a36-7c62-4ccc-8583-afd86c837e3f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:10.321654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322705-f3ae-4a59-81f0-c62ba8981d2e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:10.322142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d322705-f3ae-4a59-81f0-c62ba8981d2e None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:10.326193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d322705-f3ae-4a59-81f0-c62ba8981d2e None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-857f9a36-7c62-4ccc-8583-afd86c837e3f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:10.330386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:10.331238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:10.332002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:10.334253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d322705-f3ae-4a59-81f0-c62ba8981d2e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:10.336360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 63/128] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:10 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:10.338055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d322705-f3ae-4a59-81f0-c62ba8981d2e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.339002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 66/129] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:10 2022] GET /identity/v3/roles/member => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:10.343081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9a36-7c62-4ccc-8583-afd86c837e3f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.528441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857f9a36-7c62-4ccc-8583-afd86c837e3f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:10.542150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d322705-f3ae-4a59-81f0-c62ba8981d2e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:10.581449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:10.595946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b620-cbea-460a-b04c-46e5dd9aa712 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:10.596847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b620-cbea-460a-b04c-46e5dd9aa712 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:10.597136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b620-cbea-460a-b04c-46e5dd9aa712 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:10.597437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c811b620-cbea-460a-b04c-46e5dd9aa712 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83/users/a284f7c10ba148eab43b0163d0db6ba7/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:10.601218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b620-cbea-460a-b04c-46e5dd9aa712 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89be6274838409da0aafbfa44983f83, user_id=a284f7c10ba148eab43b0163d0db6ba7, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:10.602711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c811b620-cbea-460a-b04c-46e5dd9aa712 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:10.611040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8518c-9e4e-457c-b7e1-f45226d82ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:10.611931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8518c-9e4e-457c-b7e1-f45226d82ab7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:10.612215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8518c-9e4e-457c-b7e1-f45226d82ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:10.612493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf8518c-9e4e-457c-b7e1-f45226d82ab7 None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:10.613734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8518c-9e4e-457c-b7e1-f45226d82ab7 None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:10.615186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bf8518c-9e4e-457c-b7e1-f45226d82ab7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:10.616998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 64/130] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:10 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:10.618956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8518c-9e4e-457c-b7e1-f45226d82ab7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.637636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 67/131] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:10 2022] PUT /identity/v3/projects/f89be6274838409da0aafbfa44983f83/users/a284f7c10ba148eab43b0163d0db6ba7/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:10.638615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b620-cbea-460a-b04c-46e5dd9aa712 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.720405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:10.770901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bf8518c-9e4e-457c-b7e1-f45226d82ab7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:10.831535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:10.832217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:10.832503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:10.832776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:10.833575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:10.833884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:10.835295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:10.838869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c811b620-cbea-460a-b04c-46e5dd9aa712 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:10.857983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 65/132] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:10 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:10.863769 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.910095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095493b-c92c-44d3-af3e-1ee21b9ae23e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:10.910991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095493b-c92c-44d3-af3e-1ee21b9ae23e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:10.911333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095493b-c92c-44d3-af3e-1ee21b9ae23e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:10.911618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f095493b-c92c-44d3-af3e-1ee21b9ae23e None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:10.913089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095493b-c92c-44d3-af3e-1ee21b9ae23e None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:10.914589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f095493b-c92c-44d3-af3e-1ee21b9ae23e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:10.916586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 68/133] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:10 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:10.923249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095493b-c92c-44d3-af3e-1ee21b9ae23e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:10.934794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:10.991640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf670475-2f63-4a9d-b1dd-d85b1fd3aef7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:11.027959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a937e53-a16d-4cba-85d0-3a7dba3b4003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:11.028840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a937e53-a16d-4cba-85d0-3a7dba3b4003 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:11.029119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a937e53-a16d-4cba-85d0-3a7dba3b4003 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:11.029394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a937e53-a16d-4cba-85d0-3a7dba3b4003 None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:11.030836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a937e53-a16d-4cba-85d0-3a7dba3b4003 None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:11.032387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a937e53-a16d-4cba-85d0-3a7dba3b4003 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:11.034584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 66/134] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:10 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:11.039475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a937e53-a16d-4cba-85d0-3a7dba3b4003 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:11.040502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f095493b-c92c-44d3-af3e-1ee21b9ae23e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:11.051379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:11.080163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c29f1-4fb4-439f-b5f8-5ef8ad9f87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:11.081165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c29f1-4fb4-439f-b5f8-5ef8ad9f87c7 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:11.081477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c29f1-4fb4-439f-b5f8-5ef8ad9f87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:11.081924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5c29f1-4fb4-439f-b5f8-5ef8ad9f87c7 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83/users/6f25eff4460b401a9650f91f232be225/roles/dd9d89d3dbf5451ba6661a3634837e37` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:11.084279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c29f1-4fb4-439f-b5f8-5ef8ad9f87c7 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89be6274838409da0aafbfa44983f83, user_id=6f25eff4460b401a9650f91f232be225, role_id=dd9d89d3dbf5451ba6661a3634837e37)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:11.086148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5c29f1-4fb4-439f-b5f8-5ef8ad9f87c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:11.104025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 69/135] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:10 2022] PUT /identity/v3/projects/f89be6274838409da0aafbfa44983f83/users/6f25eff4460b401a9650f91f232be225/roles/dd9d89d3dbf5451ba6661a3634837e37 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:23:11.197900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a937e53-a16d-4cba-85d0-3a7dba3b4003 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:11.227108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:11.251324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e8b2-2369-4f47-b3e3-f935ad269396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:11.252148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e8b2-2369-4f47-b3e3-f935ad269396 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:11.252437 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e8b2-2369-4f47-b3e3-f935ad269396 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:11.252719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e8b2-2369-4f47-b3e3-f935ad269396 None admin] PATH_INFO: `/v3/projects/073fd0eb4bfe4a7ea9315dd77f5df195` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:11.253978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e8b2-2369-4f47-b3e3-f935ad269396 None admin] RBAC: Authorizing `identity:get_project(project_id=073fd0eb4bfe4a7ea9315dd77f5df195)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:11.255454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e8b2-2369-4f47-b3e3-f935ad269396 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:11.257553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 67/136] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:11 2022] GET /identity/v3/projects/073fd0eb4bfe4a7ea9315dd77f5df195 => generated 312 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:11.262883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c29f1-4fb4-439f-b5f8-5ef8ad9f87c7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:11.399615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5c29f1-4fb4-439f-b5f8-5ef8ad9f87c7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:11.436083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95ded6f-51cb-4e47-9e46-c66a83082796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:11.437602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ded6f-51cb-4e47-9e46-c66a83082796 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:11.437895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ded6f-51cb-4e47-9e46-c66a83082796 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:11.438176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95ded6f-51cb-4e47-9e46-c66a83082796 None admin] PATH_INFO: `/v3/projects/073fd0eb4bfe4a7ea9315dd77f5df195/users/6f25eff4460b401a9650f91f232be225/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:11.440213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ded6f-51cb-4e47-9e46-c66a83082796 None admin] RBAC: Authorizing `identity:create_grant(project_id=073fd0eb4bfe4a7ea9315dd77f5df195, user_id=6f25eff4460b401a9650f91f232be225, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:11.441732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95ded6f-51cb-4e47-9e46-c66a83082796 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:11.461990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 70/137] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:11 2022] PUT /identity/v3/projects/073fd0eb4bfe4a7ea9315dd77f5df195/users/6f25eff4460b401a9650f91f232be225/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:11.654366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0a86-640c-45e3-8a49-fef24a098f19 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:11.655905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0a86-640c-45e3-8a49-fef24a098f19 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:11.656396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5f0a86-640c-45e3-8a49-fef24a098f19 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:11.658032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 68/138] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:11.663550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ba64-46d3-49ca-8405-868edbb8dc07 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:11.664414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ba64-46d3-49ca-8405-868edbb8dc07 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:11.664891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f4ba64-46d3-49ca-8405-868edbb8dc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:11.683620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-42f4ba64-46d3-49ca-8405-868edbb8dc07 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:11.685159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-42f4ba64-46d3-49ca-8405-868edbb8dc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:11.713022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:11.765401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 71/139] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:11.823314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f0a86-640c-45e3-8a49-fef24a098f19 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:11.946588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc5f0a86-640c-45e3-8a49-fef24a098f19 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:12.004471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b70833b0-bc73-4c15-8ffe-342e838c4ac2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:12.005323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70833b0-bc73-4c15-8ffe-342e838c4ac2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:12.005739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70833b0-bc73-4c15-8ffe-342e838c4ac2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:12.006116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b70833b0-bc73-4c15-8ffe-342e838c4ac2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:12.007345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70833b0-bc73-4c15-8ffe-342e838c4ac2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:12.008921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b70833b0-bc73-4c15-8ffe-342e838c4ac2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:12.011035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 69/140] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:11 2022] GET /identity/v3/domains/default => generated 199 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:12.018781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4ba64-46d3-49ca-8405-868edbb8dc07 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:12.145137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f4ba64-46d3-49ca-8405-868edbb8dc07 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:12.184246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4992706-6b4d-4c47-ab64-f06de96b1c70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:12.184939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4992706-6b4d-4c47-ab64-f06de96b1c70 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:12.185230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4992706-6b4d-4c47-ab64-f06de96b1c70 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:12.185534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4992706-6b4d-4c47-ab64-f06de96b1c70 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:12.186284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4992706-6b4d-4c47-ab64-f06de96b1c70 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:12.188023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4992706-6b4d-4c47-ab64-f06de96b1c70 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:12.226441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 72/141] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:12 2022] POST /identity/v3/users => generated 283 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:13.059974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52d16-5daf-48e6-89e3-3e50e2658c0c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.060595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52d16-5daf-48e6-89e3-3e50e2658c0c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.060595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e52d16-5daf-48e6-89e3-3e50e2658c0c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.062676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 70/142] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:13.070056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db23d-4f8b-434c-abbd-6036574c655a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.070056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db23d-4f8b-434c-abbd-6036574c655a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.070056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a98db23d-4f8b-434c-abbd-6036574c655a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.087134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a98db23d-4f8b-434c-abbd-6036574c655a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:13.088635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a98db23d-4f8b-434c-abbd-6036574c655a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:13.099827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:13.163853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 73/143] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:13.188318 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52d16-5daf-48e6-89e3-3e50e2658c0c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:13.248314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:13.297046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e52d16-5daf-48e6-89e3-3e50e2658c0c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:13.332475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b74c9c80-21f1-444f-9b22-8cfe0a069dfb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:13.333201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9c80-21f1-444f-9b22-8cfe0a069dfb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.333537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9c80-21f1-444f-9b22-8cfe0a069dfb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.333815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74c9c80-21f1-444f-9b22-8cfe0a069dfb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.345050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b74c9c80-21f1-444f-9b22-8cfe0a069dfb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b74c9c80-21f1-444f-9b22-8cfe0a069dfb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:13.352955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:13.353884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:13.354663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:13.355727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 71/144] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:13.361684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db23d-4f8b-434c-abbd-6036574c655a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:13.415595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da005d5-1eb8-489e-83b9-ec6ea06592c0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.415886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da005d5-1eb8-489e-83b9-ec6ea06592c0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.416182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da005d5-1eb8-489e-83b9-ec6ea06592c0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.417655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 72/145] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:13.423758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3c28-18fb-4622-a14e-7aafe456d49a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.424046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3c28-18fb-4622-a14e-7aafe456d49a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.424327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ade3c28-18fb-4622-a14e-7aafe456d49a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.444480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6ade3c28-18fb-4622-a14e-7aafe456d49a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:13.445707 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6ade3c28-18fb-4622-a14e-7aafe456d49a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:13.532201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 73/146] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:13.552189 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3c28-18fb-4622-a14e-7aafe456d49a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:13.552495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a98db23d-4f8b-434c-abbd-6036574c655a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:13.613880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:13.663069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:13.663756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.664039 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.664313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.665078 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:13.665383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:13.665922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ade3c28-18fb-4622-a14e-7aafe456d49a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:13.671444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:13.695719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 74/147] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:13.707380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:13.708715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976bbe9-b8bc-4095-affe-2444fd8ed88b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:13.709611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976bbe9-b8bc-4095-affe-2444fd8ed88b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.709896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976bbe9-b8bc-4095-affe-2444fd8ed88b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.710171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6976bbe9-b8bc-4095-affe-2444fd8ed88b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.723248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6976bbe9-b8bc-4095-affe-2444fd8ed88b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:13.733945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6976bbe9-b8bc-4095-affe-2444fd8ed88b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:13.734168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:13.735307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:13.736060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 74/148] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:13 2022] GET /identity/v3/roles/reader => generated 84 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:13.742510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976bbe9-b8bc-4095-affe-2444fd8ed88b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:13.878404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6976bbe9-b8bc-4095-affe-2444fd8ed88b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:13.881798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:13.895849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d39b7342-969c-43e8-a94b-49ca1266eada None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:13.923096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989d45aa-ff5a-46ee-bae0-1e26762c6ef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:13.923591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d45aa-ff5a-46ee-bae0-1e26762c6ef0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.923872 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d45aa-ff5a-46ee-bae0-1e26762c6ef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.924152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989d45aa-ff5a-46ee-bae0-1e26762c6ef0 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.925373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d45aa-ff5a-46ee-bae0-1e26762c6ef0 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:13.925710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d45aa-ff5a-46ee-bae0-1e26762c6ef0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:13.927380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989d45aa-ff5a-46ee-bae0-1e26762c6ef0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:13.938646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc7f296-35ff-4de5-a991-38b3851c097d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:13.939855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f296-35ff-4de5-a991-38b3851c097d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.940421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 75/149] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:13 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:13.940625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f296-35ff-4de5-a991-38b3851c097d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.941094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc7f296-35ff-4de5-a991-38b3851c097d None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.942666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7f296-35ff-4de5-a991-38b3851c097d None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:13.944375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc7f296-35ff-4de5-a991-38b3851c097d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:13.946151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f0644-e446-4029-933e-278714e392fe None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.946442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f0644-e446-4029-933e-278714e392fe None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.946724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296f0644-e446-4029-933e-278714e392fe None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.946959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 75/150] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:13 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:13.948235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 76/151] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:13.954180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f0644-e446-4029-933e-278714e392fe None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:13.954805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cd74-4be1-4a23-abdf-1d4d920f2ce9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:13.955401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cd74-4be1-4a23-abdf-1d4d920f2ce9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:13.955948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d911cd74-4be1-4a23-abdf-1d4d920f2ce9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:13.976520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d911cd74-4be1-4a23-abdf-1d4d920f2ce9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:13.978166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d911cd74-4be1-4a23-abdf-1d4d920f2ce9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:14.065945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 76/152] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) Jul 12 08:23:14.067231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911cd74-4be1-4a23-abdf-1d4d920f2ce9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:14.078472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:14.083789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296f0644-e446-4029-933e-278714e392fe None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:14.126287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a338e2e-8de8-4085-984e-f5d91ae73139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:14.127346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a338e2e-8de8-4085-984e-f5d91ae73139 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:14.127634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a338e2e-8de8-4085-984e-f5d91ae73139 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:14.127907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a338e2e-8de8-4085-984e-f5d91ae73139 None admin] PATH_INFO: `/v3/users/b6b0ab19bfee4341bd17dc571217db61` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:14.130120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a338e2e-8de8-4085-984e-f5d91ae73139 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b0ab19bfee4341bd17dc571217db61)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:14.133603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a338e2e-8de8-4085-984e-f5d91ae73139 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:14.135302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 77/153] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:13 2022] GET /identity/v3/users/b6b0ab19bfee4341bd17dc571217db61 => generated 289 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:14.140371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a338e2e-8de8-4085-984e-f5d91ae73139 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:14.191473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:14.249563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d911cd74-4be1-4a23-abdf-1d4d920f2ce9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:14.304084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a338e2e-8de8-4085-984e-f5d91ae73139 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:14.320614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a74da-7cc2-4571-a9f2-1bb23ce44413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:14.321640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a74da-7cc2-4571-a9f2-1bb23ce44413 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:14.322134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a74da-7cc2-4571-a9f2-1bb23ce44413 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:14.322608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a74da-7cc2-4571-a9f2-1bb23ce44413 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:14.379094 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef931-b13b-4305-8f6d-3667bce44bce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:14.380336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef931-b13b-4305-8f6d-3667bce44bce None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:14.380826 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef931-b13b-4305-8f6d-3667bce44bce None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:14.381302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b8ef931-b13b-4305-8f6d-3667bce44bce None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:14.403209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b8ef931-b13b-4305-8f6d-3667bce44bce None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2b8ef931-b13b-4305-8f6d-3667bce44bce None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:14.417616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:14.418445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:14.419364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:14.421955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 78/154] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:14.426572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef931-b13b-4305-8f6d-3667bce44bce None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:14.457967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a74da-7cc2-4571-a9f2-1bb23ce44413 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:14.459520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e8a74da-7cc2-4571-a9f2-1bb23ce44413 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:14.464861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:14.541654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:14.555561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b8ef931-b13b-4305-8f6d-3667bce44bce None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:14.607756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 77/155] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 541 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:14.609256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a74da-7cc2-4571-a9f2-1bb23ce44413 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:14.631410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8df8-7949-4724-8a5f-9d6651553f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:14.632199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8df8-7949-4724-8a5f-9d6651553f35 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:14.632476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8df8-7949-4724-8a5f-9d6651553f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:14.632747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90e8df8-7949-4724-8a5f-9d6651553f35 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:14.634000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e8df8-7949-4724-8a5f-9d6651553f35 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:14.635461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c90e8df8-7949-4724-8a5f-9d6651553f35 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:14.637173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 79/156] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:14 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:14.643164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8df8-7949-4724-8a5f-9d6651553f35 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:14.833629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a74da-7cc2-4571-a9f2-1bb23ce44413 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:14.836465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:14.881221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:14.881979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:14.882211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:14.882484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:14.883232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:14.883535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:14.884907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:14.894311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 78/157] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:14.894923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:14.901766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90e8df8-7949-4724-8a5f-9d6651553f35 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:14.982661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b0104d-62ef-428b-b39d-22470d95a35f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:14.984077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0104d-62ef-428b-b39d-22470d95a35f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:14.984366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0104d-62ef-428b-b39d-22470d95a35f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:14.984657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b0104d-62ef-428b-b39d-22470d95a35f None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:14.985851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0104d-62ef-428b-b39d-22470d95a35f None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:14.987303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b0104d-62ef-428b-b39d-22470d95a35f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:14.993531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 80/158] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:14 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:14.994823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb4cf-3405-4dc3-aa91-6296305b1d29 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:14.995107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb4cf-3405-4dc3-aa91-6296305b1d29 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:14.995387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-615cb4cf-3405-4dc3-aa91-6296305b1d29 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:14.996793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 81/159] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:14.998577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb4cf-3405-4dc3-aa91-6296305b1d29 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:15.019919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c37307-4b70-4a0d-b8bb-233273ca45ee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:15.034621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:15.079846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd66c59-5b9f-409b-a23b-2ab98e3e78b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:15.081335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66c59-5b9f-409b-a23b-2ab98e3e78b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:15.082661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66c59-5b9f-409b-a23b-2ab98e3e78b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:15.083845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd66c59-5b9f-409b-a23b-2ab98e3e78b1 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83/users/b6b0ab19bfee4341bd17dc571217db61/roles/4b79664b5ed44a6f9ce2785fe2729fa1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:15.087254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd66c59-5b9f-409b-a23b-2ab98e3e78b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89be6274838409da0aafbfa44983f83, user_id=b6b0ab19bfee4341bd17dc571217db61, role_id=4b79664b5ed44a6f9ce2785fe2729fa1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:15.089041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fd66c59-5b9f-409b-a23b-2ab98e3e78b1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:15.112305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 79/160] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:14 2022] PUT /identity/v3/projects/f89be6274838409da0aafbfa44983f83/users/b6b0ab19bfee4341bd17dc571217db61/roles/4b79664b5ed44a6f9ce2785fe2729fa1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:15.114652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248a90-6db8-462f-9fc9-9f709c503bda None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:15.115764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248a90-6db8-462f-9fc9-9f709c503bda None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:15.116361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8248a90-6db8-462f-9fc9-9f709c503bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:15.150641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a8248a90-6db8-462f-9fc9-9f709c503bda None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:15.152268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8248a90-6db8-462f-9fc9-9f709c503bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:15.193834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:15.194896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-615cb4cf-3405-4dc3-aa91-6296305b1d29 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:15.263855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ed0b-180e-447a-974d-52240661f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:15.264797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ed0b-180e-447a-974d-52240661f777 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:15.265058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ed0b-180e-447a-974d-52240661f777 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:15.265322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d8ed0b-180e-447a-974d-52240661f777 None admin] PATH_INFO: `/v3/users/a284f7c10ba148eab43b0163d0db6ba7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:15.270230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8ed0b-180e-447a-974d-52240661f777 None admin] RBAC: Authorizing `identity:get_user(user_id=a284f7c10ba148eab43b0163d0db6ba7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:15.271708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d8ed0b-180e-447a-974d-52240661f777 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:15.273492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 82/161] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:14 2022] GET /identity/v3/users/a284f7c10ba148eab43b0163d0db6ba7 => generated 247 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:15.274259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ed0b-180e-447a-974d-52240661f777 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:15.307988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 80/162] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:15.308803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8248a90-6db8-462f-9fc9-9f709c503bda None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:15.488470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:15.497677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d8ed0b-180e-447a-974d-52240661f777 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:15.514133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8248a90-6db8-462f-9fc9-9f709c503bda None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:15.541000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:15.541787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:15.542068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:15.542342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:15.543184 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] RBAC: Adding query filter params (role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=f89be6274838409da0aafbfa44983f83, user.id=6f25eff4460b401a9650f91f232be225) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:15.543494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:15.544928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:15.557299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 83/163] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:15 2022] GET /identity/v3/role_assignments?user.id=6f25eff4460b401a9650f91f232be225&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=672aed7af8e9436a801cd1eca8806cce => generated 608 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:15.558287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:15.600258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0149dde3-332e-47f1-be9f-e42ac5578095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:15.601012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149dde3-332e-47f1-be9f-e42ac5578095 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:15.601294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149dde3-332e-47f1-be9f-e42ac5578095 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:15.601593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0149dde3-332e-47f1-be9f-e42ac5578095 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:15.658107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:15.692835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a600d261-e3c5-4681-bc5a-ed6a54a7c701 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:15.737569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70d3c609-df41-4072-87a7-b8c040212198 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:15.738632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c609-df41-4072-87a7-b8c040212198 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:15.739087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c609-df41-4072-87a7-b8c040212198 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:15.739521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70d3c609-df41-4072-87a7-b8c040212198 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:15.754685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149dde3-332e-47f1-be9f-e42ac5578095 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:15.756184 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0149dde3-332e-47f1-be9f-e42ac5578095 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:15.756517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70d3c609-df41-4072-87a7-b8c040212198 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-70d3c609-df41-4072-87a7-b8c040212198 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:15.765464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:15.766402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:15.767176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:15.775414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 84/164] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:15 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:15.778655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37a58-0b2e-4dfb-8f4a-1fd0692df24f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:15.778942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37a58-0b2e-4dfb-8f4a-1fd0692df24f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:15.779222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc37a58-0b2e-4dfb-8f4a-1fd0692df24f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:15.781032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 85/165] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:15 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:15.786603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc37a58-0b2e-4dfb-8f4a-1fd0692df24f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:15.827706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:15.978670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 81/166] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:15.979861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8bd9-09f1-481d-bca7-5a907403d8a3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:15.980154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8bd9-09f1-481d-bca7-5a907403d8a3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:15.980433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076b8bd9-09f1-481d-bca7-5a907403d8a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:15.994169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc37a58-0b2e-4dfb-8f4a-1fd0692df24f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:16.013865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-076b8bd9-09f1-481d-bca7-5a907403d8a3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:16.015664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-076b8bd9-09f1-481d-bca7-5a907403d8a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:16.054117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:16.054796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:16.055080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:16.055359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:16.056126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:16.056435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:16.057856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:16.067272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 86/167] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:15 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:16.067941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:16.107406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:16.143023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 82/168] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:16.143930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b8bd9-09f1-481d-bca7-5a907403d8a3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:16.185344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:16.225135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97a8f04-f4c8-4503-9c17-9f93b27268c2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:16.311638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d236f-6a1c-4de2-89e6-742dc219c70f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:16.312555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d236f-6a1c-4de2-89e6-742dc219c70f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:16.312844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d236f-6a1c-4de2-89e6-742dc219c70f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:16.313117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b8d236f-6a1c-4de2-89e6-742dc219c70f None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:16.318171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d236f-6a1c-4de2-89e6-742dc219c70f None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:16.319647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b8d236f-6a1c-4de2-89e6-742dc219c70f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:16.321578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 87/169] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:16 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:16.322193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d236f-6a1c-4de2-89e6-742dc219c70f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:16.337162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076b8bd9-09f1-481d-bca7-5a907403d8a3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:16.416507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fda2-3959-47d1-a430-31be235706a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:16.416507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fda2-3959-47d1-a430-31be235706a5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:16.416507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fda2-3959-47d1-a430-31be235706a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:16.416930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b585fda2-3959-47d1-a430-31be235706a5 None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:16.421450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585fda2-3959-47d1-a430-31be235706a5 None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:16.423067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b585fda2-3959-47d1-a430-31be235706a5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:16.424587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 83/170] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:16 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:16.425193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fda2-3959-47d1-a430-31be235706a5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:16.537212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b8d236f-6a1c-4de2-89e6-742dc219c70f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:16.573833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:16.600715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfa9f0-db8a-4cf2-a111-22373d53e545 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:16.602231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfa9f0-db8a-4cf2-a111-22373d53e545 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:16.602713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfa9f0-db8a-4cf2-a111-22373d53e545 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:16.603195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdfa9f0-db8a-4cf2-a111-22373d53e545 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:16.630480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdfa9f0-db8a-4cf2-a111-22373d53e545 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8bdfa9f0-db8a-4cf2-a111-22373d53e545 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:16.644538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:16.645500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:16.646297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:16.649217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 88/171] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:16 2022] GET /identity/v3/roles/member => generated 84 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:16.650547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfa9f0-db8a-4cf2-a111-22373d53e545 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:16.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:16.743363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b585fda2-3959-47d1-a430-31be235706a5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:16.815907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdfa9f0-db8a-4cf2-a111-22373d53e545 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:16.848975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:16.849649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:16.849939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:16.850220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:16.851062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=f89be6274838409da0aafbfa44983f83, user.id=a284f7c10ba148eab43b0163d0db6ba7) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:16.851366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:16.852806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:16.859194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 84/172] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:16 2022] GET /identity/v3/role_assignments?user.id=a284f7c10ba148eab43b0163d0db6ba7&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 608 bytes in 434 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:16.859977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:16.877543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d92e86-7ff5-4400-94b8-6da23c9dfe73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:16.878494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92e86-7ff5-4400-94b8-6da23c9dfe73 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:16.878775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92e86-7ff5-4400-94b8-6da23c9dfe73 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:16.879055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d92e86-7ff5-4400-94b8-6da23c9dfe73 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.000984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d92e86-7ff5-4400-94b8-6da23c9dfe73 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:17.003440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d92e86-7ff5-4400-94b8-6da23c9dfe73 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:17.028577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:17.060981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ebf4d1-b460-470b-9b05-04ee7d880c3a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:17.106193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:17.131942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36da093c-1f20-4b30-839b-38f8ef6419a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:17.132722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da093c-1f20-4b30-839b-38f8ef6419a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.132906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da093c-1f20-4b30-839b-38f8ef6419a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.133172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36da093c-1f20-4b30-839b-38f8ef6419a3 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.134332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da093c-1f20-4b30-839b-38f8ef6419a3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:17.134332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da093c-1f20-4b30-839b-38f8ef6419a3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:17.135693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36da093c-1f20-4b30-839b-38f8ef6419a3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:17.145869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 85/173] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:17.147174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc256b1c-2ec9-496d-9a1a-9686d8799481 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.147457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc256b1c-2ec9-496d-9a1a-9686d8799481 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.147729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc256b1c-2ec9-496d-9a1a-9686d8799481 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.149036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 86/174] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:17.153454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132f7c9-93e6-4a65-9749-cf8b77cd48d3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.153454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132f7c9-93e6-4a65-9749-cf8b77cd48d3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.153454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4132f7c9-93e6-4a65-9749-cf8b77cd48d3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.153454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 87/175] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:17.158239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132f7c9-93e6-4a65-9749-cf8b77cd48d3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:17.182126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 89/176] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:17.184087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40a120-3b45-48d0-800f-93e9b453093d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.184593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40a120-3b45-48d0-800f-93e9b453093d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.185073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d40a120-3b45-48d0-800f-93e9b453093d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.207952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2d40a120-3b45-48d0-800f-93e9b453093d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:17.210440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2d40a120-3b45-48d0-800f-93e9b453093d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:17.289177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4132f7c9-93e6-4a65-9749-cf8b77cd48d3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:17.296029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 90/177] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:17.298617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5816-563d-4119-a19a-9188ec33aa84 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.299116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5816-563d-4119-a19a-9188ec33aa84 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.299957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-281f5816-563d-4119-a19a-9188ec33aa84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.326537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-281f5816-563d-4119-a19a-9188ec33aa84 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:17.328324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-281f5816-563d-4119-a19a-9188ec33aa84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:17.335286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a20e08-9540-4386-9718-ac715afd1285 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:17.336172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20e08-9540-4386-9718-ac715afd1285 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.336450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20e08-9540-4386-9718-ac715afd1285 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.336724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a20e08-9540-4386-9718-ac715afd1285 None admin] PATH_INFO: `/v3/users/6f25eff4460b401a9650f91f232be225` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.338064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a20e08-9540-4386-9718-ac715afd1285 None admin] RBAC: Authorizing `identity:get_user(user_id=6f25eff4460b401a9650f91f232be225)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:17.339504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a20e08-9540-4386-9718-ac715afd1285 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:17.341274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 88/178] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:17 2022] GET /identity/v3/users/6f25eff4460b401a9650f91f232be225 => generated 275 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:17.341993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a20e08-9540-4386-9718-ac715afd1285 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:17.382274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:17.395120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:17.425222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 91/179] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:17.430793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83c89-6dcd-4fc0-aaf5-4dc34ced7851 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.431159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83c89-6dcd-4fc0-aaf5-4dc34ced7851 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.431507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd83c89-6dcd-4fc0-aaf5-4dc34ced7851 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.433032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 92/180] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:17.435388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83c89-6dcd-4fc0-aaf5-4dc34ced7851 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:17.462070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a20e08-9540-4386-9718-ac715afd1285 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:17.496863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c916da-de08-478c-a0b8-84106e9f16e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:17.497758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c916da-de08-478c-a0b8-84106e9f16e6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.498032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c916da-de08-478c-a0b8-84106e9f16e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.498310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5c916da-de08-478c-a0b8-84106e9f16e6 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.499510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c916da-de08-478c-a0b8-84106e9f16e6 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:17.500962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5c916da-de08-478c-a0b8-84106e9f16e6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:17.502713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 89/181] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:17 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:17.503457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c916da-de08-478c-a0b8-84106e9f16e6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:17.552323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dd83c89-6dcd-4fc0-aaf5-4dc34ced7851 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:17.589282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe7fd06-6452-4806-84e3-3e5d7eac455a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:17.590334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7fd06-6452-4806-84e3-3e5d7eac455a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.590780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7fd06-6452-4806-84e3-3e5d7eac455a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.591316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe7fd06-6452-4806-84e3-3e5d7eac455a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.592484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7fd06-6452-4806-84e3-3e5d7eac455a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:17.595582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe7fd06-6452-4806-84e3-3e5d7eac455a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:17.601976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 93/182] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:17.603167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5c916da-de08-478c-a0b8-84106e9f16e6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:17.603286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabfcf2-6343-4b8f-9d1c-68ed2a77f2e0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.603567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabfcf2-6343-4b8f-9d1c-68ed2a77f2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.603847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfabfcf2-6343-4b8f-9d1c-68ed2a77f2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.619618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:17.622985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bfabfcf2-6343-4b8f-9d1c-68ed2a77f2e0 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:17.624961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bfabfcf2-6343-4b8f-9d1c-68ed2a77f2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:17.638710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34305390-585e-4437-ae5d-9878270ba969 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:17.639296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305390-585e-4437-ae5d-9878270ba969 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.639649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305390-585e-4437-ae5d-9878270ba969 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.640057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34305390-585e-4437-ae5d-9878270ba969 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.660800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:17.699513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 94/183] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:17.700419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabfcf2-6343-4b8f-9d1c-68ed2a77f2e0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:17.733274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34305390-585e-4437-ae5d-9878270ba969 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:17.734815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34305390-585e-4437-ae5d-9878270ba969 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:17.806915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfabfcf2-6343-4b8f-9d1c-68ed2a77f2e0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:17.841542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95c08-b1cf-4ae9-9b95-b61c62c48bef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:17.842717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95c08-b1cf-4ae9-9b95-b61c62c48bef None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.843227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95c08-b1cf-4ae9-9b95-b61c62c48bef None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:17.843672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb95c08-b1cf-4ae9-9b95-b61c62c48bef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:17.850246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 90/184] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 343 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:17.850246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34305390-585e-4437-ae5d-9878270ba969 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:17.859576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb95c08-b1cf-4ae9-9b95-b61c62c48bef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:17.866278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-dcb95c08-b1cf-4ae9-9b95-b61c62c48bef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:17.867152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:17.868032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:17.868902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 95/185] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:17.870268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95c08-b1cf-4ae9-9b95-b61c62c48bef None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:17.904508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:17.963092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34305390-585e-4437-ae5d-9878270ba969 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:17.988742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb95c08-b1cf-4ae9-9b95-b61c62c48bef None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:17.998845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:17.999502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:17.999786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.000061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.000896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] RBAC: Adding query filter params (role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=f89be6274838409da0aafbfa44983f83, user.id=6f25eff4460b401a9650f91f232be225) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:18.001206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:18.002675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:18.008873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 91/186] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:17 2022] GET /identity/v3/role_assignments?user.id=6f25eff4460b401a9650f91f232be225&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:18.010296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:18.028576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82359d1-140f-48f4-b2b5-f5226fd3076a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:18.029373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82359d1-140f-48f4-b2b5-f5226fd3076a None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.029761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82359d1-140f-48f4-b2b5-f5226fd3076a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.030165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b82359d1-140f-48f4-b2b5-f5226fd3076a None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.031505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82359d1-140f-48f4-b2b5-f5226fd3076a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:18.033811 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b82359d1-140f-48f4-b2b5-f5226fd3076a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:18.064275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 96/187] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:17 2022] POST /identity/v3/users => generated 297 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:18.070582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82359d1-140f-48f4-b2b5-f5226fd3076a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:18.153730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:18.180846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd69db34-bf49-4a0f-962d-a4cc09282b49 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:18.205263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:18.227842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b82359d1-140f-48f4-b2b5-f5226fd3076a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:18.233779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d776bb-f917-4ba0-aac6-418f5e7b12e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:18.234910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d776bb-f917-4ba0-aac6-418f5e7b12e3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.235377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d776bb-f917-4ba0-aac6-418f5e7b12e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.235649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d776bb-f917-4ba0-aac6-418f5e7b12e3 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.255483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d776bb-f917-4ba0-aac6-418f5e7b12e3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-36d776bb-f917-4ba0-aac6-418f5e7b12e3 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:18.266516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:18.267504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:18.268306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:18.270995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 92/188] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:18.272013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d776bb-f917-4ba0-aac6-418f5e7b12e3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:18.281306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a00183-d837-41a3-aad8-dea9727b5842 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:18.282589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00183-d837-41a3-aad8-dea9727b5842 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.282878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00183-d837-41a3-aad8-dea9727b5842 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.283146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a00183-d837-41a3-aad8-dea9727b5842 None admin] PATH_INFO: `/v3/projects/073fd0eb4bfe4a7ea9315dd77f5df195` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.284384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a00183-d837-41a3-aad8-dea9727b5842 None admin] RBAC: Authorizing `identity:get_project(project_id=073fd0eb4bfe4a7ea9315dd77f5df195)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:18.285891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a00183-d837-41a3-aad8-dea9727b5842 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:18.287610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 97/189] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/projects/073fd0eb4bfe4a7ea9315dd77f5df195 => generated 312 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:18.289037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2816-8e3d-40be-bdc7-78db7455ff19 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.289304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2816-8e3d-40be-bdc7-78db7455ff19 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.289928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0e2816-8e3d-40be-bdc7-78db7455ff19 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.291766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 98/190] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:18.292549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2816-8e3d-40be-bdc7-78db7455ff19 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:18.396950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d776bb-f917-4ba0-aac6-418f5e7b12e3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:18.427879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0e2816-8e3d-40be-bdc7-78db7455ff19 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:18.446933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdf8ce4-6dd3-4fc0-8b1a-366caffea446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:18.447527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8ce4-6dd3-4fc0-8b1a-366caffea446 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.447805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8ce4-6dd3-4fc0-8b1a-366caffea446 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.448070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdf8ce4-6dd3-4fc0-8b1a-366caffea446 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.448827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8ce4-6dd3-4fc0-8b1a-366caffea446 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:18.449127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8ce4-6dd3-4fc0-8b1a-366caffea446 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:18.450547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdf8ce4-6dd3-4fc0-8b1a-366caffea446 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:18.459963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 93/191] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:18.461890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007101-9278-4aea-80ba-55f3683ce948 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.461890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007101-9278-4aea-80ba-55f3683ce948 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.461890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09007101-9278-4aea-80ba-55f3683ce948 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.466718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:18.472111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:18.472790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.473072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.473349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.474137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:18.474442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:18.475829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:18.482771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-09007101-9278-4aea-80ba-55f3683ce948 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:18.484712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-09007101-9278-4aea-80ba-55f3683ce948 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:18.485735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 99/192] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:18.486255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:18.504860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:18.561876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 94/193] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:18.562608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09007101-9278-4aea-80ba-55f3683ce948 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:18.627512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c6cbe5-86a2-4815-a94f-8b3d82fcebb8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:18.666006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:18.666743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.667024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.667322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.668362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] RBAC: Adding query filter params (role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=073fd0eb4bfe4a7ea9315dd77f5df195, user.id=6f25eff4460b401a9650f91f232be225) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:18.668729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:18.670543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:18.678889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 100/194] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/role_assignments?user.id=6f25eff4460b401a9650f91f232be225&scope.project.id=073fd0eb4bfe4a7ea9315dd77f5df195&role.id=672aed7af8e9436a801cd1eca8806cce => generated 608 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:18.679890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:18.767561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09007101-9278-4aea-80ba-55f3683ce948 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:18.785225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:18.809818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ca5adc-e5f9-44c5-aa1d-378dd4b62bb0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:18.854097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d26c-0ce2-426e-a6a7-26751766e113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:18.854986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d26c-0ce2-426e-a6a7-26751766e113 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.855261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d26c-0ce2-426e-a6a7-26751766e113 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.855531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2950d26c-0ce2-426e-a6a7-26751766e113 None admin] PATH_INFO: `/v3/users/e5635dd40c364f22be1bd688be5c056f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.862629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:18.877806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4059a-4fd1-44be-82ae-e892eff5ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:18.878702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4059a-4fd1-44be-82ae-e892eff5ebad None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:18.878981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4059a-4fd1-44be-82ae-e892eff5ebad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:18.879251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4059a-4fd1-44be-82ae-e892eff5ebad None admin] PATH_INFO: `/v3/users/e5635dd40c364f22be1bd688be5c056f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:18.894220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d26c-0ce2-426e-a6a7-26751766e113 None admin] RBAC: Authorizing `identity:get_user(user_id=e5635dd40c364f22be1bd688be5c056f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:18.895840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2950d26c-0ce2-426e-a6a7-26751766e113 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:18.898012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 101/195] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/users/e5635dd40c364f22be1bd688be5c056f => generated 283 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:18.898576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d26c-0ce2-426e-a6a7-26751766e113 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:18.900728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4059a-4fd1-44be-82ae-e892eff5ebad None admin] RBAC: Authorizing `identity:get_user(user_id=e5635dd40c364f22be1bd688be5c056f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:18.902481 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf4059a-4fd1-44be-82ae-e892eff5ebad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:18.906612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 95/196] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/users/e5635dd40c364f22be1bd688be5c056f => generated 283 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:18.907432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4059a-4fd1-44be-82ae-e892eff5ebad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:19.026427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2950d26c-0ce2-426e-a6a7-26751766e113 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:19.037650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4059a-4fd1-44be-82ae-e892eff5ebad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:19.078350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e929ab-d018-4e97-a119-6d378c56dedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:19.079154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e929ab-d018-4e97-a119-6d378c56dedb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:19.079432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e929ab-d018-4e97-a119-6d378c56dedb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:19.079704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e929ab-d018-4e97-a119-6d378c56dedb None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:19.089006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:19.095584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461f361-7eb5-49b9-94ef-65fab43fc275 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:19.096627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e929ab-d018-4e97-a119-6d378c56dedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:19.096824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f361-7eb5-49b9-94ef-65fab43fc275 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:19.096988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f361-7eb5-49b9-94ef-65fab43fc275 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:19.097205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d461f361-7eb5-49b9-94ef-65fab43fc275 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-23e929ab-d018-4e97-a119-6d378c56dedb None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:19.115335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:19.117966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 102/197] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:19.120374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e929ab-d018-4e97-a119-6d378c56dedb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:19.166491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:19.179279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461f361-7eb5-49b9-94ef-65fab43fc275 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:19.181394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d461f361-7eb5-49b9-94ef-65fab43fc275 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:19.290945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e929ab-d018-4e97-a119-6d378c56dedb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:19.297674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 96/198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:18 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:19.298339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461f361-7eb5-49b9-94ef-65fab43fc275 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:19.342021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad69b3c-32e0-4e20-b28e-318f955fdc86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:19.343560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69b3c-32e0-4e20-b28e-318f955fdc86 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:19.344203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69b3c-32e0-4e20-b28e-318f955fdc86 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:19.344838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad69b3c-32e0-4e20-b28e-318f955fdc86 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:19.393084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:19.403309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d461f361-7eb5-49b9-94ef-65fab43fc275 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:19.439695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:19.441550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:19.442289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:19.443534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:19.443534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:19.443534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:19.443848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:19.445032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad69b3c-32e0-4e20-b28e-318f955fdc86 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:19.445258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:19.447255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad69b3c-32e0-4e20-b28e-318f955fdc86 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:19.456112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 97/199] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:19 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:19.456752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:19.567858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9585ee09-9b72-41f9-9691-fec0cf4f40cb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:19.576539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 103/200] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 458 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:19.578132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad69b3c-32e0-4e20-b28e-318f955fdc86 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:19.612578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d3c0-44c8-4792-bcdb-04f084d579b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:19.614447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3c0-44c8-4792-bcdb-04f084d579b8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:19.614904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3c0-44c8-4792-bcdb-04f084d579b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:19.615649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f6d3c0-44c8-4792-bcdb-04f084d579b8 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:19.617802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6d3c0-44c8-4792-bcdb-04f084d579b8 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:19.619750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f6d3c0-44c8-4792-bcdb-04f084d579b8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:19.622815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 98/201] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:19 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:19.624523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d3c0-44c8-4792-bcdb-04f084d579b8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:19.653573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:19.710279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:19.715312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad69b3c-32e0-4e20-b28e-318f955fdc86 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:19.760310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca47c65-3011-40d6-8c21-9793947887e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:19.761464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca47c65-3011-40d6-8c21-9793947887e4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:19.761758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca47c65-3011-40d6-8c21-9793947887e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:19.762037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca47c65-3011-40d6-8c21-9793947887e4 None admin] PATH_INFO: `/v3/users/b6b0ab19bfee4341bd17dc571217db61` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:19.763660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca47c65-3011-40d6-8c21-9793947887e4 None admin] RBAC: Authorizing `identity:get_user(user_id=b6b0ab19bfee4341bd17dc571217db61)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:19.765918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca47c65-3011-40d6-8c21-9793947887e4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:19.768254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 104/202] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:19 2022] GET /identity/v3/users/b6b0ab19bfee4341bd17dc571217db61 => generated 289 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:19.773318 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca47c65-3011-40d6-8c21-9793947887e4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:19.780950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f6d3c0-44c8-4792-bcdb-04f084d579b8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:19.830485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46913ba0-dce1-4e03-b107-5b193c6b51d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:19.831276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913ba0-dce1-4e03-b107-5b193c6b51d6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:19.831559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913ba0-dce1-4e03-b107-5b193c6b51d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:19.831837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46913ba0-dce1-4e03-b107-5b193c6b51d6 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:19.833649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46913ba0-dce1-4e03-b107-5b193c6b51d6 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:19.835264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46913ba0-dce1-4e03-b107-5b193c6b51d6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:19.837725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 99/203] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:19 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:19.844661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46913ba0-dce1-4e03-b107-5b193c6b51d6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:19.929938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca47c65-3011-40d6-8c21-9793947887e4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:19.981364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:19.991114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:19.992333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:19.992729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:19.993111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:19.995125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] RBAC: Adding query filter params (role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=2d273344a1544875bfddfa250520784b, user.id=e5635dd40c364f22be1bd688be5c056f) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:19.995524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:19.997295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:19.998095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46913ba0-dce1-4e03-b107-5b193c6b51d6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:20.009620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 105/204] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:19 2022] GET /identity/v3/role_assignments?user.id=e5635dd40c364f22be1bd688be5c056f&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 259 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:20.012336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:20.074059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3086277-6fb2-4336-9249-84308531e35c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:20.075245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3086277-6fb2-4336-9249-84308531e35c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:20.076977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3086277-6fb2-4336-9249-84308531e35c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:20.077732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:20.078631 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3086277-6fb2-4336-9249-84308531e35c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:20.219441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4d633e8-3d07-4ee3-ac3a-5d138e808d0f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:20.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3086277-6fb2-4336-9249-84308531e35c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:20.223369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3086277-6fb2-4336-9249-84308531e35c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:20.294405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:20.295130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:20.295415 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:20.296657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:20.297743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=2d273344a1544875bfddfa250520784b, user.id=e5635dd40c364f22be1bd688be5c056f) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:20.298064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:20.299876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:20.307876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 106/205] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:20 2022] GET /identity/v3/role_assignments?user.id=e5635dd40c364f22be1bd688be5c056f&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 259 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:20.425148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:20.445756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 100/206] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:20.451675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:20.558005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e3d78-dba4-464a-952d-9a1b9e059a0a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:20.558778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e3d78-dba4-464a-952d-9a1b9e059a0a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:20.559424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0e3d78-dba4-464a-952d-9a1b9e059a0a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:20.562258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 101/207] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:20.569169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585fe6-ef47-4064-a64e-583f1acfa531 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:20.569471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585fe6-ef47-4064-a64e-583f1acfa531 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:20.569746 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c585fe6-ef47-4064-a64e-583f1acfa531 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:20.579366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:20.587039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1422a8-e1d9-439d-bd0d-29d82c58542a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:20.590234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6c585fe6-ef47-4064-a64e-583f1acfa531 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:20.591410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6c585fe6-ef47-4064-a64e-583f1acfa531 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:20.643079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ddc20-6d03-404d-8f93-02173dbfcb49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:20.644740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ddc20-6d03-404d-8f93-02173dbfcb49 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:20.645965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ddc20-6d03-404d-8f93-02173dbfcb49 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:20.647029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23ddc20-6d03-404d-8f93-02173dbfcb49 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:20.649166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ddc20-6d03-404d-8f93-02173dbfcb49 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:20.651584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23ddc20-6d03-404d-8f93-02173dbfcb49 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:20.656996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 107/208] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:20 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:20.662400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ddc20-6d03-404d-8f93-02173dbfcb49 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:20.699581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 102/209] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:20.705442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c539-23c3-4b40-8a4a-be85e369d0de None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:20.705442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c539-23c3-4b40-8a4a-be85e369d0de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:20.705442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8014c539-23c3-4b40-8a4a-be85e369d0de None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:20.708300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 103/210] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:20.710486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fe346-00c3-45da-bc8f-c2741da645ab None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:20.710879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fe346-00c3-45da-bc8f-c2741da645ab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:20.711264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e4fe346-00c3-45da-bc8f-c2741da645ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:20.733117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4e4fe346-00c3-45da-bc8f-c2741da645ab None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:20.735308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4e4fe346-00c3-45da-bc8f-c2741da645ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:20.807930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23ddc20-6d03-404d-8f93-02173dbfcb49 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:20.831648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 104/211] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:20.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fe346-00c3-45da-bc8f-c2741da645ab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:20.847638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:20.848296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:20.848630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:20.848907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:20.850076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] RBAC: Adding query filter params (role.id=4b79664b5ed44a6f9ce2785fe2729fa1, scope.project.id=f89be6274838409da0aafbfa44983f83, user.id=b6b0ab19bfee4341bd17dc571217db61) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:20.850382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:20.851876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:20.859512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 108/212] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:20 2022] GET /identity/v3/role_assignments?user.id=b6b0ab19bfee4341bd17dc571217db61&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=4b79664b5ed44a6f9ce2785fe2729fa1 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:20.881265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:20.931959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:20.943535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:20.989282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e4fe346-00c3-45da-bc8f-c2741da645ab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:21.028283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a2928-b28b-4197-90fb-00521d5825fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:21.029587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2928-b28b-4197-90fb-00521d5825fa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:21.029894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2928-b28b-4197-90fb-00521d5825fa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:21.030738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a08a2928-b28b-4197-90fb-00521d5825fa None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:21.032144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a2928-b28b-4197-90fb-00521d5825fa None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:21.033876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a08a2928-b28b-4197-90fb-00521d5825fa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:21.035602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 105/213] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:21.041512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a2928-b28b-4197-90fb-00521d5825fa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:21.119598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9801ac-667c-4862-982d-1e1ce8ac2a0d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:21.167019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a08a2928-b28b-4197-90fb-00521d5825fa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:21.169265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888018b-dcdc-44a4-a6ea-87379701ec79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:21.170221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888018b-dcdc-44a4-a6ea-87379701ec79 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:21.170570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888018b-dcdc-44a4-a6ea-87379701ec79 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:21.171565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888018b-dcdc-44a4-a6ea-87379701ec79 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:21.190703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888018b-dcdc-44a4-a6ea-87379701ec79 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:21.197768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5888018b-dcdc-44a4-a6ea-87379701ec79 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:21.199761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:21.200635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:21.201445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 109/214] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:21.211745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888018b-dcdc-44a4-a6ea-87379701ec79 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:21.213920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf1425-dc29-46dc-a5be-91d3ad3c82e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:21.214610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf1425-dc29-46dc-a5be-91d3ad3c82e8 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:21.214893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf1425-dc29-46dc-a5be-91d3ad3c82e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:21.215167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbf1425-dc29-46dc-a5be-91d3ad3c82e8 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:21.216213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf1425-dc29-46dc-a5be-91d3ad3c82e8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:21.217857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbf1425-dc29-46dc-a5be-91d3ad3c82e8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:21.245512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 106/215] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:21 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:21.387970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:21.414958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888018b-dcdc-44a4-a6ea-87379701ec79 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:21.454583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:21.455329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:21.455581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:21.455850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:21.456704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:21.457013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:21.458472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:21.467819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 110/216] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:21 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:21.474418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf1425-dc29-46dc-a5be-91d3ad3c82e8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:21.589829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbf1425-dc29-46dc-a5be-91d3ad3c82e8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:21.635051 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd1df-3443-4103-aa59-2f9aade6cecb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:21.635945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd1df-3443-4103-aa59-2f9aade6cecb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:21.636229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd1df-3443-4103-aa59-2f9aade6cecb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:21.636502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dacd1df-3443-4103-aa59-2f9aade6cecb None admin] PATH_INFO: `/v3/users/d5984d6764ca4fbaa0240e6fc1e0d84f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:21.658219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd1df-3443-4103-aa59-2f9aade6cecb None admin] RBAC: Authorizing `identity:get_user(user_id=d5984d6764ca4fbaa0240e6fc1e0d84f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:21.659655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dacd1df-3443-4103-aa59-2f9aade6cecb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:21.661807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 107/217] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:21 2022] GET /identity/v3/users/d5984d6764ca4fbaa0240e6fc1e0d84f => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:21.668172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:21.825727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f14a07ff-4f16-4f12-aced-15450dc94957 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:21.883228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f80b-83a3-4174-b631-020862265fca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:21.883883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f80b-83a3-4174-b631-020862265fca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:21.884162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f80b-83a3-4174-b631-020862265fca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:21.884435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f09f80b-83a3-4174-b631-020862265fca None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:21.909279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:21.984930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f80b-83a3-4174-b631-020862265fca None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:21.986442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f09f80b-83a3-4174-b631-020862265fca None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:22.122099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 111/218] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:22.127941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd1df-3443-4103-aa59-2f9aade6cecb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:22.187719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:22.287104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dacd1df-3443-4103-aa59-2f9aade6cecb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:22.342280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db686a8-929b-4cc2-82e6-a83e1e6faa91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:22.343296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db686a8-929b-4cc2-82e6-a83e1e6faa91 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:22.343574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db686a8-929b-4cc2-82e6-a83e1e6faa91 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:22.343847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db686a8-929b-4cc2-82e6-a83e1e6faa91 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:22.350167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db686a8-929b-4cc2-82e6-a83e1e6faa91 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:22.351637 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db686a8-929b-4cc2-82e6-a83e1e6faa91 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:22.353695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 108/219] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:22 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:22.360173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f80b-83a3-4174-b631-020862265fca None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:22.453403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:22.521716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8cafc-1982-479d-9075-ecd9e6e5599a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:22.522043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8cafc-1982-479d-9075-ecd9e6e5599a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:22.522261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8b8cafc-1982-479d-9075-ecd9e6e5599a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:22.523729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 109/220] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:22.528868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188a8b-56db-464b-9125-ece5ea623944 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:22.529147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188a8b-56db-464b-9125-ece5ea623944 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:22.529461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a188a8b-56db-464b-9125-ece5ea623944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:22.532164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f09f80b-83a3-4174-b631-020862265fca None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:22.548276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3a188a8b-56db-464b-9125-ece5ea623944 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:22.549610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3a188a8b-56db-464b-9125-ece5ea623944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:22.586310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:22.586974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:22.587258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:22.587540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:22.588377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] RBAC: Adding query filter params (role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=2d273344a1544875bfddfa250520784b, user.id=d5984d6764ca4fbaa0240e6fc1e0d84f) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:22.588743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:22.590273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:22.596480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 112/221] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:22 2022] GET /identity/v3/role_assignments?user.id=d5984d6764ca4fbaa0240e6fc1e0d84f&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=672aed7af8e9436a801cd1eca8806cce => generated 259 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:22.646238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 110/222] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:22.681454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:22.798032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0046ecef-dc27-4863-acba-1238728eef24 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:22.821810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:22.841854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d48fca-fd0d-4b03-bd63-9c2113d6bc04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:22.843494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48fca-fd0d-4b03-bd63-9c2113d6bc04 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:22.843933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48fca-fd0d-4b03-bd63-9c2113d6bc04 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:22.844266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d48fca-fd0d-4b03-bd63-9c2113d6bc04 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:22.859760 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d48fca-fd0d-4b03-bd63-9c2113d6bc04 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d8d48fca-fd0d-4b03-bd63-9c2113d6bc04 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:22.868144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:22.869017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:22.869831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 113/223] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:22.877132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a188a8b-56db-464b-9125-ece5ea623944 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:22.888100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a35f5-24d8-428f-a6d0-84ba5b4e96e8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:22.888100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a35f5-24d8-428f-a6d0-84ba5b4e96e8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:22.888100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63a35f5-24d8-428f-a6d0-84ba5b4e96e8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:22.888100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 114/224] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:22.894297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89befcb3-e33b-4d0d-8480-3528d19841ec None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:22.894780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89befcb3-e33b-4d0d-8480-3528d19841ec None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:22.895059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89befcb3-e33b-4d0d-8480-3528d19841ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:22.917807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-89befcb3-e33b-4d0d-8480-3528d19841ec None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:22.919195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-89befcb3-e33b-4d0d-8480-3528d19841ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:22.931505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:23.003112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 115/225] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:23.035388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89befcb3-e33b-4d0d-8480-3528d19841ec None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:23.075709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a188a8b-56db-464b-9125-ece5ea623944 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:23.156016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89befcb3-e33b-4d0d-8480-3528d19841ec None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:23.157559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:23.163634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ba644-23b4-4925-8567-c341df615829 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:23.164323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ba644-23b4-4925-8567-c341df615829 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:23.164609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ba644-23b4-4925-8567-c341df615829 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:23.164878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ba644-23b4-4925-8567-c341df615829 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:23.165774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ba644-23b4-4925-8567-c341df615829 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:23.166085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ba644-23b4-4925-8567-c341df615829 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:23.173262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-337ba644-23b4-4925-8567-c341df615829 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:23.195381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 111/226] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:23.206349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ba644-23b4-4925-8567-c341df615829 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:23.213171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d3fe9-a549-4ed6-80d1-4b3efe0c609d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:23.214001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d3fe9-a549-4ed6-80d1-4b3efe0c609d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:23.214288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d3fe9-a549-4ed6-80d1-4b3efe0c609d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:23.214561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041d3fe9-a549-4ed6-80d1-4b3efe0c609d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:23.239191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041d3fe9-a549-4ed6-80d1-4b3efe0c609d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-041d3fe9-a549-4ed6-80d1-4b3efe0c609d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:23.254715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:23.255628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:23.256416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 116/227] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:23.268133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d3fe9-a549-4ed6-80d1-4b3efe0c609d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:23.386713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:23.409102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ba644-23b4-4925-8567-c341df615829 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:23.469210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041d3fe9-a549-4ed6-80d1-4b3efe0c609d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:23.474042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b86a35-6606-4b87-81fa-4a9dd3f0dc00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:23.475206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86a35-6606-4b87-81fa-4a9dd3f0dc00 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:23.475691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86a35-6606-4b87-81fa-4a9dd3f0dc00 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:23.476162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b86a35-6606-4b87-81fa-4a9dd3f0dc00 None admin] PATH_INFO: `/v3/users/e5635dd40c364f22be1bd688be5c056f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:23.477898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b86a35-6606-4b87-81fa-4a9dd3f0dc00 None admin] RBAC: Authorizing `identity:get_user(user_id=e5635dd40c364f22be1bd688be5c056f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:23.484676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2b86a35-6606-4b87-81fa-4a9dd3f0dc00 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:23.487132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 112/228] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:23 2022] GET /identity/v3/users/e5635dd40c364f22be1bd688be5c056f => generated 283 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:23.495828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b86a35-6606-4b87-81fa-4a9dd3f0dc00 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:23.543588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:23.544969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:23.545483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:23.546857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:23.547813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:23.548484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:23.551148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:23.571577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 117/229] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:23.578485 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:23.627220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:23.681442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b86a35-6606-4b87-81fa-4a9dd3f0dc00 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:23.718357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1f410-8ed0-406c-a205-08b554f46dd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:23.719760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f410-8ed0-406c-a205-08b554f46dd6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:23.720241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f410-8ed0-406c-a205-08b554f46dd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:23.720713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e1f410-8ed0-406c-a205-08b554f46dd6 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:23.722893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f410-8ed0-406c-a205-08b554f46dd6 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:23.726435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e1f410-8ed0-406c-a205-08b554f46dd6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:23.730661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 113/230] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:23 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:23.736760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1f410-8ed0-406c-a205-08b554f46dd6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:23.790283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e07c8480-48d4-4013-8e2e-c4153de5d54e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:23.804744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:23.826147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc744b4-2291-42ab-b275-eb001f4bd9ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:23.827958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc744b4-2291-42ab-b275-eb001f4bd9ea None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:23.828438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc744b4-2291-42ab-b275-eb001f4bd9ea None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:23.828906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc744b4-2291-42ab-b275-eb001f4bd9ea None admin] PATH_INFO: `/v3/users/e5635dd40c364f22be1bd688be5c056f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:23.830333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc744b4-2291-42ab-b275-eb001f4bd9ea None admin] RBAC: Authorizing `identity:get_user(user_id=e5635dd40c364f22be1bd688be5c056f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:23.832090 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc744b4-2291-42ab-b275-eb001f4bd9ea None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:23.834064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 118/231] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:23 2022] GET /identity/v3/users/e5635dd40c364f22be1bd688be5c056f => generated 283 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:23.850031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc744b4-2291-42ab-b275-eb001f4bd9ea None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:23.954180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e1f410-8ed0-406c-a205-08b554f46dd6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:24.003674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1faf9e20-478e-403d-9db3-84a2b94f036c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:24.005628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9e20-478e-403d-9db3-84a2b94f036c None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.006220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9e20-478e-403d-9db3-84a2b94f036c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.006764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1faf9e20-478e-403d-9db3-84a2b94f036c None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b/users/e5635dd40c364f22be1bd688be5c056f/roles/dd9d89d3dbf5451ba6661a3634837e37` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.008342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:24.010953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf9e20-478e-403d-9db3-84a2b94f036c None admin] RBAC: Authorizing `identity:create_grant(project_id=2d273344a1544875bfddfa250520784b, user_id=e5635dd40c364f22be1bd688be5c056f, role_id=dd9d89d3dbf5451ba6661a3634837e37)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:24.013540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1faf9e20-478e-403d-9db3-84a2b94f036c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:24.020113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc744b4-2291-42ab-b275-eb001f4bd9ea None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:24.034398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 114/232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:23 2022] PUT /identity/v3/projects/2d273344a1544875bfddfa250520784b/users/e5635dd40c364f22be1bd688be5c056f/roles/dd9d89d3dbf5451ba6661a3634837e37 => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:23:24.036488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa135033-a849-40ad-8997-0489e5c8cd59 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.036959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa135033-a849-40ad-8997-0489e5c8cd59 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.038050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa135033-a849-40ad-8997-0489e5c8cd59 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.040007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 115/233] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:24 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:24.048095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d9f9-27c8-4f4d-a1c0-254fe31c0d4e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.048306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d9f9-27c8-4f4d-a1c0-254fe31c0d4e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.049838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e1d9f9-27c8-4f4d-a1c0-254fe31c0d4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.084050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a1e1d9f9-27c8-4f4d-a1c0-254fe31c0d4e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:24.087188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1e1d9f9-27c8-4f4d-a1c0-254fe31c0d4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:24.090087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bede9fb-7469-47aa-ad78-6de4554ced64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:24.091102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bede9fb-7469-47aa-ad78-6de4554ced64 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.091382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bede9fb-7469-47aa-ad78-6de4554ced64 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.091702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bede9fb-7469-47aa-ad78-6de4554ced64 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.094198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bede9fb-7469-47aa-ad78-6de4554ced64 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:24.095781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bede9fb-7469-47aa-ad78-6de4554ced64 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:24.097661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 119/234] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:23 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:24.103444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bede9fb-7469-47aa-ad78-6de4554ced64 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:24.200319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 116/235] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:24.202829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954c7a-3c27-4545-b140-19292ad0c25d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.203386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954c7a-3c27-4545-b140-19292ad0c25d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.203859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31954c7a-3c27-4545-b140-19292ad0c25d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.205506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 117/236] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:24.211513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337768c-10c3-4827-b8f3-c2b9314c1993 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.212131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337768c-10c3-4827-b8f3-c2b9314c1993 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.212648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337768c-10c3-4827-b8f3-c2b9314c1993 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.234214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4337768c-10c3-4827-b8f3-c2b9314c1993 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:24.235726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4337768c-10c3-4827-b8f3-c2b9314c1993 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:24.247826 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:24.277104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bede9fb-7469-47aa-ad78-6de4554ced64 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:24.312931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295c94-8519-4d68-95cf-3a2698bf9d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:24.313950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295c94-8519-4d68-95cf-3a2698bf9d07 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.314236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295c94-8519-4d68-95cf-3a2698bf9d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.314557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df295c94-8519-4d68-95cf-3a2698bf9d07 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b/users/e5635dd40c364f22be1bd688be5c056f/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.316614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295c94-8519-4d68-95cf-3a2698bf9d07 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d273344a1544875bfddfa250520784b, user_id=e5635dd40c364f22be1bd688be5c056f, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:24.318222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df295c94-8519-4d68-95cf-3a2698bf9d07 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:24.324060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 118/237] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:24.325330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337768c-10c3-4827-b8f3-c2b9314c1993 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:24.343484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 120/238] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:24 2022] PUT /identity/v3/projects/2d273344a1544875bfddfa250520784b/users/e5635dd40c364f22be1bd688be5c056f/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:23:24.352120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295c94-8519-4d68-95cf-3a2698bf9d07 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:24.386099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:24.472365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337768c-10c3-4827-b8f3-c2b9314c1993 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:24.510524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779a48-b791-42d9-9599-648dc5d45a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:24.512340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779a48-b791-42d9-9599-648dc5d45a41 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.512340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779a48-b791-42d9-9599-648dc5d45a41 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.512340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779a48-b791-42d9-9599-648dc5d45a41 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.513295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5779a48-b791-42d9-9599-648dc5d45a41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:24.515525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5779a48-b791-42d9-9599-648dc5d45a41 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:24.517525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 119/239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:24.522951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779a48-b791-42d9-9599-648dc5d45a41 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:24.539452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:24.582828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df295c94-8519-4d68-95cf-3a2698bf9d07 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:24.619592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01f9b-3cb9-412c-9f77-ce1f2dccf735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:24.620387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01f9b-3cb9-412c-9f77-ce1f2dccf735 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.620720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01f9b-3cb9-412c-9f77-ce1f2dccf735 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.621091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f01f9b-3cb9-412c-9f77-ce1f2dccf735 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.632392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f01f9b-3cb9-412c-9f77-ce1f2dccf735 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:24.641630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779a48-b791-42d9-9599-648dc5d45a41 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-18f01f9b-3cb9-412c-9f77-ce1f2dccf735 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:24.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:24.642950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:24.643756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 121/240] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:24 2022] GET /identity/v3/roles/reader => generated 84 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:24.651327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01f9b-3cb9-412c-9f77-ce1f2dccf735 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:24.679595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a8605-73c2-44b2-99f6-f494b6e410ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:24.680275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a8605-73c2-44b2-99f6-f494b6e410ad None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.680728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a8605-73c2-44b2-99f6-f494b6e410ad None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.681094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084a8605-73c2-44b2-99f6-f494b6e410ad None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.682136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a8605-73c2-44b2-99f6-f494b6e410ad None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:24.683608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-084a8605-73c2-44b2-99f6-f494b6e410ad None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:24.718239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 120/241] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:24 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:23:24.768039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:24.794654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f01f9b-3cb9-412c-9f77-ce1f2dccf735 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:24.845505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:24.846190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:24.846467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:24.846736 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:24.847504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:24.847808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:24.849248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:24.865452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 122/242] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:24.871156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a8605-73c2-44b2-99f6-f494b6e410ad None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:24.961864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:25.006571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084a8605-73c2-44b2-99f6-f494b6e410ad None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:25.043701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70fe2964-2baa-4c7d-8be1-2dcb9f915bfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:25.044591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe2964-2baa-4c7d-8be1-2dcb9f915bfd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:25.044871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe2964-2baa-4c7d-8be1-2dcb9f915bfd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:25.045171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70fe2964-2baa-4c7d-8be1-2dcb9f915bfd None admin] PATH_INFO: `/v3/users/0068c5af0dd747dbb3cd2f9da2db9aef` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:25.059686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe2964-2baa-4c7d-8be1-2dcb9f915bfd None admin] RBAC: Authorizing `identity:get_user(user_id=0068c5af0dd747dbb3cd2f9da2db9aef)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:25.061733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70fe2964-2baa-4c7d-8be1-2dcb9f915bfd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:25.063642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 121/243] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:24 2022] GET /identity/v3/users/0068c5af0dd747dbb3cd2f9da2db9aef => generated 297 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:25.069181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:25.103896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa66d-82c8-40d8-96ee-8127ffd27901 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:25.104459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa66d-82c8-40d8-96ee-8127ffd27901 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:25.104910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c6fa66d-82c8-40d8-96ee-8127ffd27901 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:25.107103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 122/244] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:25.118026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec922618-ff16-428f-b5ad-9421d7ca129b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:25.118850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec922618-ff16-428f-b5ad-9421d7ca129b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:25.119425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec922618-ff16-428f-b5ad-9421d7ca129b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:25.142818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ec922618-ff16-428f-b5ad-9421d7ca129b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:25.144579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ec922618-ff16-428f-b5ad-9421d7ca129b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:25.224342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7babb88-cace-42fd-8456-833187e5356a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:25.245906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 123/245] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:25.265949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94e507-0629-4eb4-8561-442a098c7f4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:25.266725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94e507-0629-4eb4-8561-442a098c7f4e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:25.267008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94e507-0629-4eb4-8561-442a098c7f4e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:25.267287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae94e507-0629-4eb4-8561-442a098c7f4e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:25.275728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec922618-ff16-428f-b5ad-9421d7ca129b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:25.289475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:25.362849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:25.372182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94e507-0629-4eb4-8561-442a098c7f4e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:25.375998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae94e507-0629-4eb4-8561-442a098c7f4e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:25.434041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec922618-ff16-428f-b5ad-9421d7ca129b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:25.474945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aebb1a-9175-4729-86b2-b0143be23eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:25.475854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aebb1a-9175-4729-86b2-b0143be23eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:25.476136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aebb1a-9175-4729-86b2-b0143be23eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:25.476408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aebb1a-9175-4729-86b2-b0143be23eb4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:25.488414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aebb1a-9175-4729-86b2-b0143be23eb4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-17aebb1a-9175-4729-86b2-b0143be23eb4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:25.496823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:25.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:25.499593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 124/246] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:25 2022] GET /identity/v3/roles/member => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:25.503221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 123/247] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:25.509632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aebb1a-9175-4729-86b2-b0143be23eb4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:25.515202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94e507-0629-4eb4-8561-442a098c7f4e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:25.630406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:25.650409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aebb1a-9175-4729-86b2-b0143be23eb4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:25.684550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:25.685219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:25.685539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:25.685815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:25.687119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:25.687423 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:25.688817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:25.694339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae94e507-0629-4eb4-8561-442a098c7f4e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:25.697520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 125/248] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:25 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:25.697763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:25.703570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:25.737175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50868e-8fd9-4bb5-88bf-ccf78a8dddae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:25.738492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50868e-8fd9-4bb5-88bf-ccf78a8dddae None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:25.738999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50868e-8fd9-4bb5-88bf-ccf78a8dddae None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:25.739489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba50868e-8fd9-4bb5-88bf-ccf78a8dddae None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:25.740876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50868e-8fd9-4bb5-88bf-ccf78a8dddae None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:25.742611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba50868e-8fd9-4bb5-88bf-ccf78a8dddae None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:25.744545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 124/249] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:25 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:25.751193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50868e-8fd9-4bb5-88bf-ccf78a8dddae None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:25.864422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba50868e-8fd9-4bb5-88bf-ccf78a8dddae None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:25.876915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:25.903338 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:25.904332 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:25.904827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:25.905570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:25.906832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] RBAC: Adding query filter params (role.id=4b79664b5ed44a6f9ce2785fe2729fa1, scope.project.id=2d273344a1544875bfddfa250520784b, user.id=0068c5af0dd747dbb3cd2f9da2db9aef) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:25.907344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:25.909042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:25.915532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 125/250] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:25 2022] GET /identity/v3/role_assignments?user.id=0068c5af0dd747dbb3cd2f9da2db9aef&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=4b79664b5ed44a6f9ce2785fe2729fa1 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:25.940092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e7aa621-5e3b-4838-9121-7c7d53817f08 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:25.999237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a01981-6ad3-4e3a-a797-435face9a84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:26.000115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01981-6ad3-4e3a-a797-435face9a84c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:26.000397 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01981-6ad3-4e3a-a797-435face9a84c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:26.000673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3a01981-6ad3-4e3a-a797-435face9a84c None admin] PATH_INFO: `/v3/users/d5984d6764ca4fbaa0240e6fc1e0d84f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:26.006348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a01981-6ad3-4e3a-a797-435face9a84c None admin] RBAC: Authorizing `identity:get_user(user_id=d5984d6764ca4fbaa0240e6fc1e0d84f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:26.007830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3a01981-6ad3-4e3a-a797-435face9a84c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:26.009733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 126/251] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:25 2022] GET /identity/v3/users/d5984d6764ca4fbaa0240e6fc1e0d84f => generated 297 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:26.016206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:26.146793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce0e134-bdf2-4ee2-84d8-eee7afa23696 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:26.184951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab92303-b096-4b8a-a347-0eeab33fdc79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:26.186243 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab92303-b096-4b8a-a347-0eeab33fdc79 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:26.187282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab92303-b096-4b8a-a347-0eeab33fdc79 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:26.187758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab92303-b096-4b8a-a347-0eeab33fdc79 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:26.189248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab92303-b096-4b8a-a347-0eeab33fdc79 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:26.191154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab92303-b096-4b8a-a347-0eeab33fdc79 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:26.193174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 126/252] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:26 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:26.199091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a01981-6ad3-4e3a-a797-435face9a84c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:26.271908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:26.332567 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3a01981-6ad3-4e3a-a797-435face9a84c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:26.375152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2645ec1c-bd0e-4e54-8586-af49eed8be9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:26.376041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ec1c-bd0e-4e54-8586-af49eed8be9b None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:26.376317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ec1c-bd0e-4e54-8586-af49eed8be9b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:26.376589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2645ec1c-bd0e-4e54-8586-af49eed8be9b None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b/users/d5984d6764ca4fbaa0240e6fc1e0d84f/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:26.382728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645ec1c-bd0e-4e54-8586-af49eed8be9b None admin] RBAC: Authorizing `identity:create_grant(project_id=2d273344a1544875bfddfa250520784b, user_id=d5984d6764ca4fbaa0240e6fc1e0d84f, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:26.384171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2645ec1c-bd0e-4e54-8586-af49eed8be9b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:26.416723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 127/253] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:26 2022] PUT /identity/v3/projects/2d273344a1544875bfddfa250520784b/users/d5984d6764ca4fbaa0240e6fc1e0d84f/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:26.629735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4e78-7df1-426f-9acd-7230126cdb5c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:26.630398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4e78-7df1-426f-9acd-7230126cdb5c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:26.630884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddea4e78-7df1-426f-9acd-7230126cdb5c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:26.632884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 127/254] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:26.638273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc476118-278e-4f7e-9400-63034f546eb2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:26.638738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc476118-278e-4f7e-9400-63034f546eb2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:26.638824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc476118-278e-4f7e-9400-63034f546eb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:26.663123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dc476118-278e-4f7e-9400-63034f546eb2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:26.664330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dc476118-278e-4f7e-9400-63034f546eb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:26.764040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 128/255] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:26.805668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4e78-7df1-426f-9acd-7230126cdb5c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:26.873910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:26.936813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddea4e78-7df1-426f-9acd-7230126cdb5c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:26.976121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622143-8c6e-4e66-8cac-d23f336e1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:26.977323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622143-8c6e-4e66-8cac-d23f336e1993 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:26.977847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622143-8c6e-4e66-8cac-d23f336e1993 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:26.978317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29622143-8c6e-4e66-8cac-d23f336e1993 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:26.990036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29622143-8c6e-4e66-8cac-d23f336e1993 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-29622143-8c6e-4e66-8cac-d23f336e1993 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:26.998670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:26.999683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:27.000451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:27.002818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 128/256] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:26 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:27.010882 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc476118-278e-4f7e-9400-63034f546eb2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:27.071992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:27.137437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc476118-278e-4f7e-9400-63034f546eb2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:27.181186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:27.181887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:27.182169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:27.182444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:27.183256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:27.183565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:27.184991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:27.198454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 129/257] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:27 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:27.204214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622143-8c6e-4e66-8cac-d23f336e1993 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:27.335624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29622143-8c6e-4e66-8cac-d23f336e1993 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:27.345959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:27.371424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61dc6137-ca72-4037-932b-881ef1378b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:27.372305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6137-ca72-4037-932b-881ef1378b29 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:27.372584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6137-ca72-4037-932b-881ef1378b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:27.372858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61dc6137-ca72-4037-932b-881ef1378b29 None admin] PATH_INFO: `/v3/users/e5635dd40c364f22be1bd688be5c056f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:27.376032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc6137-ca72-4037-932b-881ef1378b29 None admin] RBAC: Authorizing `identity:get_user(user_id=e5635dd40c364f22be1bd688be5c056f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:27.377532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61dc6137-ca72-4037-932b-881ef1378b29 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:27.379193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 129/258] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:27 2022] GET /identity/v3/users/e5635dd40c364f22be1bd688be5c056f => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:27.384718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:27.395486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acb310-09db-488c-8a7e-a98e7ad11036 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:27.395767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acb310-09db-488c-8a7e-a98e7ad11036 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:27.396039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9acb310-09db-488c-8a7e-a98e7ad11036 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:27.397552 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 130/259] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:27.403159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4772aca-0669-428c-b5f8-ecaab3925630 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:27.403687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4772aca-0669-428c-b5f8-ecaab3925630 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:27.404170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4772aca-0669-428c-b5f8-ecaab3925630 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:27.432058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c4772aca-0669-428c-b5f8-ecaab3925630 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:27.433256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4772aca-0669-428c-b5f8-ecaab3925630 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:27.553987 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 131/260] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:27.586016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:27.589081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21741936-b1ef-4e2b-8773-1420b2bb7516 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:27.596374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4772aca-0669-428c-b5f8-ecaab3925630 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:27.678165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f1c0f-2f20-473d-840a-f7e1029ea76e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:27.678829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f1c0f-2f20-473d-840a-f7e1029ea76e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:27.679110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f1c0f-2f20-473d-840a-f7e1029ea76e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:27.679389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1f1c0f-2f20-473d-840a-f7e1029ea76e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:27.791665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:27.796601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4772aca-0669-428c-b5f8-ecaab3925630 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:27.842587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f1c0f-2f20-473d-840a-f7e1029ea76e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:27.844097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d1f1c0f-2f20-473d-840a-f7e1029ea76e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:27.865594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f0eb4-4d11-49c5-94d9-16c76bb809fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:27.866400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f0eb4-4d11-49c5-94d9-16c76bb809fa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:27.866733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f0eb4-4d11-49c5-94d9-16c76bb809fa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:27.867015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f0eb4-4d11-49c5-94d9-16c76bb809fa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:27.890308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f0eb4-4d11-49c5-94d9-16c76bb809fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0a0f0eb4-4d11-49c5-94d9-16c76bb809fa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:27.898928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:27.899854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:27.900900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:27.906313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 132/261] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:27.911801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f0eb4-4d11-49c5-94d9-16c76bb809fa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:28.087997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f0eb4-4d11-49c5-94d9-16c76bb809fa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:28.107839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:28.116231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 130/262] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 732 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:28.125636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f1c0f-2f20-473d-840a-f7e1029ea76e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:28.162126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:28.163239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.163804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.164147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.165120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:28.165453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:28.166859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:28.181317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 133/263] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:28.187306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:28.226220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:28.355017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1f1c0f-2f20-473d-840a-f7e1029ea76e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:28.409516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bc13ba-43d6-4f6b-91e2-835722879f49 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:28.452605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8f90ff2-a701-43c0-977e-c6b43300af86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:28.453518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f90ff2-a701-43c0-977e-c6b43300af86 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.453801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f90ff2-a701-43c0-977e-c6b43300af86 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.454079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8f90ff2-a701-43c0-977e-c6b43300af86 None admin] PATH_INFO: `/v3/users/e5635dd40c364f22be1bd688be5c056f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.455806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f90ff2-a701-43c0-977e-c6b43300af86 None admin] RBAC: Authorizing `identity:get_user(user_id=e5635dd40c364f22be1bd688be5c056f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:28.457266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8f90ff2-a701-43c0-977e-c6b43300af86 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:28.458949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 134/264] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:28 2022] GET /identity/v3/users/e5635dd40c364f22be1bd688be5c056f => generated 283 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:28.459820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870491-d20a-4cd6-91f7-3f7e8368794c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:28.460754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870491-d20a-4cd6-91f7-3f7e8368794c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.461040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870491-d20a-4cd6-91f7-3f7e8368794c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.461317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9870491-d20a-4cd6-91f7-3f7e8368794c None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.462592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9870491-d20a-4cd6-91f7-3f7e8368794c None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:28.464029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9870491-d20a-4cd6-91f7-3f7e8368794c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:28.465974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 131/265] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:28 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:28.467491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870491-d20a-4cd6-91f7-3f7e8368794c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:28.468325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31968b9-f87f-4e64-92a5-3dffa376268b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.468611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31968b9-f87f-4e64-92a5-3dffa376268b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.468885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c31968b9-f87f-4e64-92a5-3dffa376268b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.470375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 135/266] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:28 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:28.473626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31968b9-f87f-4e64-92a5-3dffa376268b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:28.606884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:28.629533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:28.650157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c31968b9-f87f-4e64-92a5-3dffa376268b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:28.661291 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9870491-d20a-4cd6-91f7-3f7e8368794c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:28.697453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911e2b60-0ba3-47d6-9b6f-168bf573d402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:28.698902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2b60-0ba3-47d6-9b6f-168bf573d402 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.699206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2b60-0ba3-47d6-9b6f-168bf573d402 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.699481 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911e2b60-0ba3-47d6-9b6f-168bf573d402 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.722644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed460eb-9134-4822-8eb8-19f7ca739e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:28.723299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed460eb-9134-4822-8eb8-19f7ca739e4c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.723577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed460eb-9134-4822-8eb8-19f7ca739e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.723849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed460eb-9134-4822-8eb8-19f7ca739e4c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.724685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed460eb-9134-4822-8eb8-19f7ca739e4c None admin] RBAC: Adding query filter params (role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=2d273344a1544875bfddfa250520784b, user.id=e5635dd40c364f22be1bd688be5c056f) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:28.725028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed460eb-9134-4822-8eb8-19f7ca739e4c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:28.727204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed460eb-9134-4822-8eb8-19f7ca739e4c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:28.741492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 136/267] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:28 2022] GET /identity/v3/role_assignments?user.id=e5635dd40c364f22be1bd688be5c056f&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 608 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:28.741492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f330b4e-7a4d-488d-b6af-6ac4e25695e4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.741492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f330b4e-7a4d-488d-b6af-6ac4e25695e4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.741492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f330b4e-7a4d-488d-b6af-6ac4e25695e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.756063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4f330b4e-7a4d-488d-b6af-6ac4e25695e4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:28.757255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4f330b4e-7a4d-488d-b6af-6ac4e25695e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:28.822674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e2b60-0ba3-47d6-9b6f-168bf573d402 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:28.824188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911e2b60-0ba3-47d6-9b6f-168bf573d402 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:28.845833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 137/268] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:28.847302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2564d-5e42-4ba8-9b59-685bd6984d24 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.848089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2564d-5e42-4ba8-9b59-685bd6984d24 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.848372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c2564d-5e42-4ba8-9b59-685bd6984d24 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.850214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 138/269] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:28.851835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c095-0d2c-41b3-8ff7-f5a572614169 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.852392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c095-0d2c-41b3-8ff7-f5a572614169 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.852673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d21c095-0d2c-41b3-8ff7-f5a572614169 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.854381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 139/270] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:28 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:28.861162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e15dee-a431-4e27-b1d1-8e26eca80e5e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.862540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e15dee-a431-4e27-b1d1-8e26eca80e5e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.862844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e15dee-a431-4e27-b1d1-8e26eca80e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.885717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-21e15dee-a431-4e27-b1d1-8e26eca80e5e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:28.887978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-21e15dee-a431-4e27-b1d1-8e26eca80e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:28.909975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:28.953727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 132/271] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:28.955057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b98edf-e100-4020-869e-2dfe4a104b64 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:28.955423 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b98edf-e100-4020-869e-2dfe4a104b64 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:28.955780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b98edf-e100-4020-869e-2dfe4a104b64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:28.974330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-38b98edf-e100-4020-869e-2dfe4a104b64 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:28.975708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-38b98edf-e100-4020-869e-2dfe4a104b64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:28.986853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 140/272] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:28.988339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e15dee-a431-4e27-b1d1-8e26eca80e5e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.016482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:29.056596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 133/273] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:29.057635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b98edf-e100-4020-869e-2dfe4a104b64 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.125249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21e15dee-a431-4e27-b1d1-8e26eca80e5e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.164462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5545-eb5b-4dd7-8428-be2fc245d8ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.165291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5545-eb5b-4dd7-8428-be2fc245d8ba None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.165574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5545-eb5b-4dd7-8428-be2fc245d8ba None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.165852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecb5545-eb5b-4dd7-8428-be2fc245d8ba None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.166154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:29.170341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b98edf-e100-4020-869e-2dfe4a104b64 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.177511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eecb5545-eb5b-4dd7-8428-be2fc245d8ba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-eecb5545-eb5b-4dd7-8428-be2fc245d8ba None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:29.185200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:29.186190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:29.187091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 141/274] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:29.192608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5545-eb5b-4dd7-8428-be2fc245d8ba None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.209738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0d0a-8ed9-494a-a832-f12dd3f0991b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.210524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0d0a-8ed9-494a-a832-f12dd3f0991b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.210805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0d0a-8ed9-494a-a832-f12dd3f0991b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.211369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fea0d0a-8ed9-494a-a832-f12dd3f0991b None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.213086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0d0a-8ed9-494a-a832-f12dd3f0991b None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:29.214576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fea0d0a-8ed9-494a-a832-f12dd3f0991b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:29.217255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 134/275] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:29.218504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0d0a-8ed9-494a-a832-f12dd3f0991b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.283584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:29.310560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eecb5545-eb5b-4dd7-8428-be2fc245d8ba None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.331399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fea0d0a-8ed9-494a-a832-f12dd3f0991b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.345621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f941-823f-410f-a8cb-639683f5e6a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.346409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f941-823f-410f-a8cb-639683f5e6a8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.346680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f941-823f-410f-a8cb-639683f5e6a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.346945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb7f941-823f-410f-a8cb-639683f5e6a8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.359019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb7f941-823f-410f-a8cb-639683f5e6a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9fb7f941-823f-410f-a8cb-639683f5e6a8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:29.366970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:29.367915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:29.368709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:29.369309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d19434-39c1-4801-bf97-327a576f2673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.369309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19434-39c1-4801-bf97-327a576f2673 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.369309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19434-39c1-4801-bf97-327a576f2673 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.369566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 142/276] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:29.369639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d19434-39c1-4801-bf97-327a576f2673 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.369706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f941-823f-410f-a8cb-639683f5e6a8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.376275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d19434-39c1-4801-bf97-327a576f2673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:29.377754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d19434-39c1-4801-bf97-327a576f2673 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:29.379483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 135/277] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:29.384548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d19434-39c1-4801-bf97-327a576f2673 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.425528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:29.481584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb7f941-823f-410f-a8cb-639683f5e6a8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.490283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d19434-39c1-4801-bf97-327a576f2673 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.515025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.515688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.515968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.516248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.516994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:29.517302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:29.518731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:29.520061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:29.524428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.525080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.525655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.525933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.526772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=2d273344a1544875bfddfa250520784b, user.id=e5635dd40c364f22be1bd688be5c056f) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:29.527080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:29.528060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 143/278] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:29.533568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:29.533658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.542715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 136/279] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/role_assignments?user.id=e5635dd40c364f22be1bd688be5c056f&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:29.542715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.649520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:29.653899 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fb09e2-f421-46cc-b1d3-7b7b84835ce6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.658800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afcb7b57-334a-466e-892c-fd5e44248cb1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.696963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837b7011-dc08-4ff9-b8a0-4db869d9ffd8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.698796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b7011-dc08-4ff9-b8a0-4db869d9ffd8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.698904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd935f5-f5ed-4242-b4ab-c838ec1fc514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.699306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b7011-dc08-4ff9-b8a0-4db869d9ffd8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.699306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837b7011-dc08-4ff9-b8a0-4db869d9ffd8 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.699432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd935f5-f5ed-4242-b4ab-c838ec1fc514 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.699432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd935f5-f5ed-4242-b4ab-c838ec1fc514 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.699572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b7011-dc08-4ff9-b8a0-4db869d9ffd8 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:29.699639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcd935f5-f5ed-4242-b4ab-c838ec1fc514 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.699705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b7011-dc08-4ff9-b8a0-4db869d9ffd8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:29.699889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd935f5-f5ed-4242-b4ab-c838ec1fc514 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:29.700704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837b7011-dc08-4ff9-b8a0-4db869d9ffd8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:29.701203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcd935f5-f5ed-4242-b4ab-c838ec1fc514 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:29.709675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 144/280] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:29.710882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7245c6c-5854-4cd5-aeab-f2502ace4a7f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.711167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7245c6c-5854-4cd5-aeab-f2502ace4a7f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.711445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7245c6c-5854-4cd5-aeab-f2502ace4a7f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.712905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 145/281] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:29.713601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7245c6c-5854-4cd5-aeab-f2502ace4a7f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.723474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 137/282] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:29 2022] POST /identity/v3/users => generated 293 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:29.724546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd935f5-f5ed-4242-b4ab-c838ec1fc514 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.792990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:29.850057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7245c6c-5854-4cd5-aeab-f2502ace4a7f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.863675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcd935f5-f5ed-4242-b4ab-c838ec1fc514 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:29.894812 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fed6c-d0ca-41c3-9be6-813cdca6591b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.896739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fed6c-d0ca-41c3-9be6-813cdca6591b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.896739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fed6c-d0ca-41c3-9be6-813cdca6591b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.896739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c58fed6c-d0ca-41c3-9be6-813cdca6591b None admin] PATH_INFO: `/v3/users/5bd86d8aa2564db9a1a325b33af7154e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.906773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5062eff6-c5ad-4b2a-9808-639190686700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:29.907650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062eff6-c5ad-4b2a-9808-639190686700 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.907924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062eff6-c5ad-4b2a-9808-639190686700 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.908196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5062eff6-c5ad-4b2a-9808-639190686700 None admin] PATH_INFO: `/v3/users/0068c5af0dd747dbb3cd2f9da2db9aef` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.909410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062eff6-c5ad-4b2a-9808-639190686700 None admin] RBAC: Authorizing `identity:get_user(user_id=0068c5af0dd747dbb3cd2f9da2db9aef)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:29.911003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5062eff6-c5ad-4b2a-9808-639190686700 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:29.912550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 138/283] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/users/0068c5af0dd747dbb3cd2f9da2db9aef => generated 297 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:29.913948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69064-617b-4e65-8780-323fb4918698 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:29.914067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fed6c-d0ca-41c3-9be6-813cdca6591b None admin] RBAC: Authorizing `identity:get_user(user_id=5bd86d8aa2564db9a1a325b33af7154e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:29.914260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69064-617b-4e65-8780-323fb4918698 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:29.914506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a69064-617b-4e65-8780-323fb4918698 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:29.915438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c58fed6c-d0ca-41c3-9be6-813cdca6591b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:29.917551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 146/284] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/users/5bd86d8aa2564db9a1a325b33af7154e => generated 293 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:29.921643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fed6c-d0ca-41c3-9be6-813cdca6591b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:29.941083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-52a69064-617b-4e65-8780-323fb4918698 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:29.942334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-52a69064-617b-4e65-8780-323fb4918698 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:29.963976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:30.032687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 139/285] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:30.033632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a69064-617b-4e65-8780-323fb4918698 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:30.063478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c58fed6c-d0ca-41c3-9be6-813cdca6591b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:30.093928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:30.114008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c2bf4-8f25-43e5-afa1-6bf93349af4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:30.115396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c2bf4-8f25-43e5-afa1-6bf93349af4f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:30.116645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c2bf4-8f25-43e5-afa1-6bf93349af4f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:30.117127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129c2bf4-8f25-43e5-afa1-6bf93349af4f None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:30.118611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c2bf4-8f25-43e5-afa1-6bf93349af4f None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:30.120264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129c2bf4-8f25-43e5-afa1-6bf93349af4f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:30.124342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 147/286] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:29 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:30.126067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c2bf4-8f25-43e5-afa1-6bf93349af4f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:30.150898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a69064-617b-4e65-8780-323fb4918698 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:30.188050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:30.188969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:30.189078 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:30.189447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:30.190487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] RBAC: Adding query filter params (role.id=672aed7af8e9436a801cd1eca8806cce, user.id=5bd86d8aa2564db9a1a325b33af7154e, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:30.190784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:30.192363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:30.198008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 140/287] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 12 08:23:30 2022] GET /identity/v3/role_assignments?user.id=5bd86d8aa2564db9a1a325b33af7154e&scope.system=all&role.id=672aed7af8e9436a801cd1eca8806cce => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:30.198894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:30.240645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:30.255683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129c2bf4-8f25-43e5-afa1-6bf93349af4f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:30.314765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5993ac-48bf-4e45-aadb-ce1f5e4ffe8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:30.316125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5993ac-48bf-4e45-aadb-ce1f5e4ffe8a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:30.316585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5993ac-48bf-4e45-aadb-ce1f5e4ffe8a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:30.317143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5993ac-48bf-4e45-aadb-ce1f5e4ffe8a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:30.346420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5993ac-48bf-4e45-aadb-ce1f5e4ffe8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5f5993ac-48bf-4e45-aadb-ce1f5e4ffe8a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:30.354645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:30.355584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:30.356397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:30.376933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 148/288] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:30.390938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5993ac-48bf-4e45-aadb-ce1f5e4ffe8a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:30.416255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2425c28-7024-4ba0-958e-d9c14680e9a7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:30.458670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e7f9a-d981-4ebf-8b75-a89560d5ae80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:30.459570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e7f9a-d981-4ebf-8b75-a89560d5ae80 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:30.459853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e7f9a-d981-4ebf-8b75-a89560d5ae80 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:30.460124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e7f9a-d981-4ebf-8b75-a89560d5ae80 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b/users/0068c5af0dd747dbb3cd2f9da2db9aef/roles/4b79664b5ed44a6f9ce2785fe2729fa1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:30.462300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e7f9a-d981-4ebf-8b75-a89560d5ae80 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d273344a1544875bfddfa250520784b, user_id=0068c5af0dd747dbb3cd2f9da2db9aef, role_id=4b79664b5ed44a6f9ce2785fe2729fa1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:30.463862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e7f9a-d981-4ebf-8b75-a89560d5ae80 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:30.478337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:30.498659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 141/289] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:23:30 2022] PUT /identity/v3/projects/2d273344a1544875bfddfa250520784b/users/0068c5af0dd747dbb3cd2f9da2db9aef/roles/4b79664b5ed44a6f9ce2785fe2729fa1 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:30.565808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5993ac-48bf-4e45-aadb-ce1f5e4ffe8a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:30.621077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:30.621788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:30.622073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:30.622352 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:30.623117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:30.623479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:30.625265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:30.634943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 149/290] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:30.644990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e7f9a-d981-4ebf-8b75-a89560d5ae80 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:30.758314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:30.779253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e7f9a-d981-4ebf-8b75-a89560d5ae80 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:30.817916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c509a8-f0a8-4915-97a9-4d650e6814cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:30.818713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c509a8-f0a8-4915-97a9-4d650e6814cb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:30.818994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c509a8-f0a8-4915-97a9-4d650e6814cb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:30.819263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21c509a8-f0a8-4915-97a9-4d650e6814cb None admin] PATH_INFO: `/v3/users/d5984d6764ca4fbaa0240e6fc1e0d84f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:30.820453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c509a8-f0a8-4915-97a9-4d650e6814cb None admin] RBAC: Authorizing `identity:get_user(user_id=d5984d6764ca4fbaa0240e6fc1e0d84f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:30.821930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21c509a8-f0a8-4915-97a9-4d650e6814cb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:30.829526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 142/291] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:30 2022] GET /identity/v3/users/d5984d6764ca4fbaa0240e6fc1e0d84f => generated 297 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:30.831718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:30.955783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6eee6685-e7d3-47df-9372-8eb30627552d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:30.963051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:31.001473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfa3bb-cc96-4c09-97fe-64c88d901796 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:31.002134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa3bb-cc96-4c09-97fe-64c88d901796 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:31.002414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa3bb-cc96-4c09-97fe-64c88d901796 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:31.002690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fcfa3bb-cc96-4c09-97fe-64c88d901796 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:31.088087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa3bb-cc96-4c09-97fe-64c88d901796 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:31.089499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fcfa3bb-cc96-4c09-97fe-64c88d901796 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:31.211682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 150/292] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:31.217398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c509a8-f0a8-4915-97a9-4d650e6814cb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:31.371097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21c509a8-f0a8-4915-97a9-4d650e6814cb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:31.426189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e248f822-db97-417e-8fb4-bb22b3b8073b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:31.427050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f822-db97-417e-8fb4-bb22b3b8073b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:31.427328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f822-db97-417e-8fb4-bb22b3b8073b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:31.427597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e248f822-db97-417e-8fb4-bb22b3b8073b None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:31.428777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248f822-db97-417e-8fb4-bb22b3b8073b None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:31.430232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e248f822-db97-417e-8fb4-bb22b3b8073b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:31.432114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 143/293] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:31 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:31.438497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfa3bb-cc96-4c09-97fe-64c88d901796 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:31.451102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:31.588197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fcfa3bb-cc96-4c09-97fe-64c88d901796 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:31.635218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9660ce2b-8499-4088-82bc-b379553f1243 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:31.635798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ce2b-8499-4088-82bc-b379553f1243 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:31.636076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ce2b-8499-4088-82bc-b379553f1243 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:31.636350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9660ce2b-8499-4088-82bc-b379553f1243 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:31.637183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660ce2b-8499-4088-82bc-b379553f1243 None admin] RBAC: Adding query filter params (role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=2d273344a1544875bfddfa250520784b, user.id=d5984d6764ca4fbaa0240e6fc1e0d84f) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:31.637527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660ce2b-8499-4088-82bc-b379553f1243 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:31.638957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9660ce2b-8499-4088-82bc-b379553f1243 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:31.650077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 151/294] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:31 2022] GET /identity/v3/role_assignments?user.id=d5984d6764ca4fbaa0240e6fc1e0d84f&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=672aed7af8e9436a801cd1eca8806cce => generated 608 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:32.190539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5b09b-c82c-4da6-ad89-5252fe861897 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.191072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5b09b-c82c-4da6-ad89-5252fe861897 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.191072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ad5b09b-c82c-4da6-ad89-5252fe861897 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.192599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 144/295] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:32.198128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaaa12-a3cc-4b20-8a9b-73e8b9f68368 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.198540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaaa12-a3cc-4b20-8a9b-73e8b9f68368 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.198681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99aaaa12-a3cc-4b20-8a9b-73e8b9f68368 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.216520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-99aaaa12-a3cc-4b20-8a9b-73e8b9f68368 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:32.218002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-99aaaa12-a3cc-4b20-8a9b-73e8b9f68368 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:32.273497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256823b-8609-4d6d-a053-8c12b33cbb58 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.274082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256823b-8609-4d6d-a053-8c12b33cbb58 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.274549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a256823b-8609-4d6d-a053-8c12b33cbb58 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.276176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 145/296] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:32.284050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b8a51-f5c1-490f-8be8-48eee6e59c52 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.284050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b8a51-f5c1-490f-8be8-48eee6e59c52 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.284050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7b8a51-f5c1-490f-8be8-48eee6e59c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.294311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:32.301193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 152/297] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:32.306305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7c7b8a51-f5c1-490f-8be8-48eee6e59c52 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:32.307734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c7b8a51-f5c1-490f-8be8-48eee6e59c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:32.316094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:32.325294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaaa12-a3cc-4b20-8a9b-73e8b9f68368 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:32.383554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 146/298] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:32.417828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b8a51-f5c1-490f-8be8-48eee6e59c52 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:32.450947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99aaaa12-a3cc-4b20-8a9b-73e8b9f68368 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:32.488598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68617d8-819b-479a-97ac-4e8fbd890af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:32.489533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68617d8-819b-479a-97ac-4e8fbd890af9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.489821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68617d8-819b-479a-97ac-4e8fbd890af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.490095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68617d8-819b-479a-97ac-4e8fbd890af9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.491289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68617d8-819b-479a-97ac-4e8fbd890af9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:32.492860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68617d8-819b-479a-97ac-4e8fbd890af9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:32.494904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 153/299] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:32.500781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68617d8-819b-479a-97ac-4e8fbd890af9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:32.542759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7b8a51-f5c1-490f-8be8-48eee6e59c52 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:32.580094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b244b6-0af1-4887-81b4-f8cb92c78ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:32.580899 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b244b6-0af1-4887-81b4-f8cb92c78ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.581181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b244b6-0af1-4887-81b4-f8cb92c78ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.581492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b244b6-0af1-4887-81b4-f8cb92c78ed4 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.592229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b244b6-0af1-4887-81b4-f8cb92c78ed4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:32.593251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-27b244b6-0af1-4887-81b4-f8cb92c78ed4 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:32.600840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:32.602908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:32.604136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:32.607702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 147/300] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:32.609485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b244b6-0af1-4887-81b4-f8cb92c78ed4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:32.612278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:32.640304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68617d8-819b-479a-97ac-4e8fbd890af9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:32.687355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96135ea-20d7-4d28-8ebe-409ff9cc21af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:32.688308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96135ea-20d7-4d28-8ebe-409ff9cc21af None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.688737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96135ea-20d7-4d28-8ebe-409ff9cc21af None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.689148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e96135ea-20d7-4d28-8ebe-409ff9cc21af None admin] PATH_INFO: `/v3/groups` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.690013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96135ea-20d7-4d28-8ebe-409ff9cc21af None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:32.691589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e96135ea-20d7-4d28-8ebe-409ff9cc21af None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:32.717945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 154/301] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Jul 12 08:23:32 2022] POST /identity/v3/groups => generated 229 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:23:32.727136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b244b6-0af1-4887-81b4-f8cb92c78ed4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:32.766915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92bf1921-c3d8-4da9-95f3-14c084094e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:32.767663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1921-c3d8-4da9-95f3-14c084094e77 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.767996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1921-c3d8-4da9-95f3-14c084094e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.768279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92bf1921-c3d8-4da9-95f3-14c084094e77 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.769100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf1921-c3d8-4da9-95f3-14c084094e77 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:32.769428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf1921-c3d8-4da9-95f3-14c084094e77 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:32.771043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92bf1921-c3d8-4da9-95f3-14c084094e77 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:32.781671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 148/302] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:32.787493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96135ea-20d7-4d28-8ebe-409ff9cc21af None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:32.829594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf47d5a-613a-4418-8f07-f3fb247f3461 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.829914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf47d5a-613a-4418-8f07-f3fb247f3461 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.830205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf47d5a-613a-4418-8f07-f3fb247f3461 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.833159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 149/303] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:32.839008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b402a83-1dae-440e-8c80-0018c37ea03f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.839309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b402a83-1dae-440e-8c80-0018c37ea03f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.839560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b402a83-1dae-440e-8c80-0018c37ea03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.861677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3b402a83-1dae-440e-8c80-0018c37ea03f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:32.863311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3b402a83-1dae-440e-8c80-0018c37ea03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:32.909631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e96135ea-20d7-4d28-8ebe-409ff9cc21af None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:32.938632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:32.942478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:32.949747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5b462-8fab-4a6f-9bba-957a58bd3a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:32.950635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b462-8fab-4a6f-9bba-957a58bd3a1a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.950920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b462-8fab-4a6f-9bba-957a58bd3a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.951198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e5b462-8fab-4a6f-9bba-957a58bd3a1a None admin] PATH_INFO: `/v3/users/2a9f2d3b4d0c400cbc54ce34433cfadd` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.954435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 150/304] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:32.969784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5b462-8fab-4a6f-9bba-957a58bd3a1a None admin] RBAC: Authorizing `identity:get_user(user_id=2a9f2d3b4d0c400cbc54ce34433cfadd)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:32.971488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35e5b462-8fab-4a6f-9bba-957a58bd3a1a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:32.973402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 155/305] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:32 2022] GET /identity/v3/users/2a9f2d3b4d0c400cbc54ce34433cfadd => generated 293 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:32.980543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5b462-8fab-4a6f-9bba-957a58bd3a1a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:32.981158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c9643-b04c-4991-98d0-226dde987486 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:32.981488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c9643-b04c-4991-98d0-226dde987486 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:32.981769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79c9643-b04c-4991-98d0-226dde987486 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:32.984080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 151/306] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:32.985696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c9643-b04c-4991-98d0-226dde987486 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:33.088875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e5b462-8fab-4a6f-9bba-957a58bd3a1a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:33.092918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79c9643-b04c-4991-98d0-226dde987486 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:33.126698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e64b5c-9fce-4725-bf43-fee56e7350a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:33.127490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64b5c-9fce-4725-bf43-fee56e7350a0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.127772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64b5c-9fce-4725-bf43-fee56e7350a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.128109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e64b5c-9fce-4725-bf43-fee56e7350a0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.129533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fe7c322-257c-4a76-82ec-90b9ffa04328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:33.130183 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c322-257c-4a76-82ec-90b9ffa04328 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.130459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c322-257c-4a76-82ec-90b9ffa04328 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.130941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe7c322-257c-4a76-82ec-90b9ffa04328 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.131553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7c322-257c-4a76-82ec-90b9ffa04328 None admin] RBAC: Adding query filter params (role.id=4b79664b5ed44a6f9ce2785fe2729fa1, user.id=2a9f2d3b4d0c400cbc54ce34433cfadd, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:33.131859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7c322-257c-4a76-82ec-90b9ffa04328 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:33.133316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fe7c322-257c-4a76-82ec-90b9ffa04328 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:33.138981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e64b5c-9fce-4725-bf43-fee56e7350a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:33.139120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 152/307] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 12 08:23:32 2022] GET /identity/v3/role_assignments?user.id=2a9f2d3b4d0c400cbc54ce34433cfadd&scope.system=all&role.id=4b79664b5ed44a6f9ce2785fe2729fa1 => generated 226 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:33.140065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6865d6a-7c9e-455b-90a8-f2a980d52103 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.140360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6865d6a-7c9e-455b-90a8-f2a980d52103 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.140632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6865d6a-7c9e-455b-90a8-f2a980d52103 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c6e64b5c-9fce-4725-bf43-fee56e7350a0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:33.158358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:33.159322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:33.160087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 156/308] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:32 2022] GET /identity/v3/roles/member => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:33.167229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e64b5c-9fce-4725-bf43-fee56e7350a0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:33.168858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b6865d6a-7c9e-455b-90a8-f2a980d52103 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:33.170272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b6865d6a-7c9e-455b-90a8-f2a980d52103 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:33.230226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:33.240915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:33.265313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 153/309] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:33.285471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6865d6a-7c9e-455b-90a8-f2a980d52103 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:33.322023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e64b5c-9fce-4725-bf43-fee56e7350a0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:33.361520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:33.362967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.363660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.364082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.365241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:33.366107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:33.367908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:33.384603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 157/310] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:33.385289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:33.417143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6865d6a-7c9e-455b-90a8-f2a980d52103 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:33.459746 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd09c41-cece-4127-b564-02c38a5620ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:33.461056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd09c41-cece-4127-b564-02c38a5620ee None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.461449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd09c41-cece-4127-b564-02c38a5620ee None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.461828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd09c41-cece-4127-b564-02c38a5620ee None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.475940 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd09c41-cece-4127-b564-02c38a5620ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4bd09c41-cece-4127-b564-02c38a5620ee None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:33.486853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:33.487742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:33.488515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 154/311] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:33 2022] GET /identity/v3/roles/reader => generated 84 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:33.496389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd09c41-cece-4127-b564-02c38a5620ee None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:33.526498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0faba6c-7a26-4e85-accd-0b5a46f930ad None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:33.539379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:33.563370 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:33.579224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b7ed9-d4c9-43a2-a50c-292dd9218762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:33.580359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b7ed9-d4c9-43a2-a50c-292dd9218762 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.581192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b7ed9-d4c9-43a2-a50c-292dd9218762 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.581518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59b7ed9-d4c9-43a2-a50c-292dd9218762 None admin] PATH_INFO: `/v3/users/5bd86d8aa2564db9a1a325b33af7154e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.583406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b7ed9-d4c9-43a2-a50c-292dd9218762 None admin] RBAC: Authorizing `identity:get_user(user_id=5bd86d8aa2564db9a1a325b33af7154e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:33.585133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59b7ed9-d4c9-43a2-a50c-292dd9218762 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:33.589481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 158/312] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:33 2022] GET /identity/v3/users/5bd86d8aa2564db9a1a325b33af7154e => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:33.592583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b7ed9-d4c9-43a2-a50c-292dd9218762 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:33.635465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd09c41-cece-4127-b564-02c38a5620ee None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:33.677146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:33.677838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.678119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.678390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.679124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:33.679423 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:33.681103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:33.694717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 155/313] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:33 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:33.695705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:33.721201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59b7ed9-d4c9-43a2-a50c-292dd9218762 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:33.764918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828cae-ac53-448b-9e03-5ae85d11cb1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:33.766451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828cae-ac53-448b-9e03-5ae85d11cb1c None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.766735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828cae-ac53-448b-9e03-5ae85d11cb1c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.767009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47828cae-ac53-448b-9e03-5ae85d11cb1c None admin] PATH_INFO: `/v3/system/users/5bd86d8aa2564db9a1a325b33af7154e/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.769128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47828cae-ac53-448b-9e03-5ae85d11cb1c None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=5bd86d8aa2564db9a1a325b33af7154e, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:33.771028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47828cae-ac53-448b-9e03-5ae85d11cb1c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:33.784847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 159/314] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Jul 12 08:23:33 2022] PUT /identity/v3/system/users/5bd86d8aa2564db9a1a325b33af7154e/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:23:33.822443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f10b2185-97ba-4800-b60e-91bf668be9de None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:33.835914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:33.864049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba4be-e8ce-4ccd-adf3-3187e4c7714e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:33.865107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba4be-e8ce-4ccd-adf3-3187e4c7714e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:33.865392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba4be-e8ce-4ccd-adf3-3187e4c7714e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:33.865865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-667ba4be-e8ce-4ccd-adf3-3187e4c7714e None admin] PATH_INFO: `/v3/users/0068c5af0dd747dbb3cd2f9da2db9aef` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:33.867411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ba4be-e8ce-4ccd-adf3-3187e4c7714e None admin] RBAC: Authorizing `identity:get_user(user_id=0068c5af0dd747dbb3cd2f9da2db9aef)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:33.869600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-667ba4be-e8ce-4ccd-adf3-3187e4c7714e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:33.871860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 156/315] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:33 2022] GET /identity/v3/users/0068c5af0dd747dbb3cd2f9da2db9aef => generated 297 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:33.877859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828cae-ac53-448b-9e03-5ae85d11cb1c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:33.926995 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:33.995832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47828cae-ac53-448b-9e03-5ae85d11cb1c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:34.031859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eab1f4-9d4e-49ba-9051-acd6986e7204 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:34.032781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab1f4-9d4e-49ba-9051-acd6986e7204 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:34.033253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab1f4-9d4e-49ba-9051-acd6986e7204 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:34.033718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78eab1f4-9d4e-49ba-9051-acd6986e7204 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:34.106520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab1f4-9d4e-49ba-9051-acd6986e7204 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:34.108075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78eab1f4-9d4e-49ba-9051-acd6986e7204 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:34.152473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:34.216024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 160/316] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:34.221828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba4be-e8ce-4ccd-adf3-3187e4c7714e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:34.331017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-667ba4be-e8ce-4ccd-adf3-3187e4c7714e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:34.365176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68de6f9c-3e7b-4ab8-a916-cbb85b18e1c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:34.366064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6f9c-3e7b-4ab8-a916-cbb85b18e1c6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:34.366345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6f9c-3e7b-4ab8-a916-cbb85b18e1c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:34.366617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68de6f9c-3e7b-4ab8-a916-cbb85b18e1c6 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:34.367800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de6f9c-3e7b-4ab8-a916-cbb85b18e1c6 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:34.369237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68de6f9c-3e7b-4ab8-a916-cbb85b18e1c6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:34.371114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 157/317] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:34 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:34.376851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eab1f4-9d4e-49ba-9051-acd6986e7204 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:34.491882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78eab1f4-9d4e-49ba-9051-acd6986e7204 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:34.528182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b7d5f10-f5ba-4541-97dd-5b4754553dde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:34.528834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d5f10-f5ba-4541-97dd-5b4754553dde None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:34.529116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d5f10-f5ba-4541-97dd-5b4754553dde None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:34.529391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b7d5f10-f5ba-4541-97dd-5b4754553dde None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:34.530803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d5f10-f5ba-4541-97dd-5b4754553dde None admin] RBAC: Adding query filter params (role.id=4b79664b5ed44a6f9ce2785fe2729fa1, scope.project.id=2d273344a1544875bfddfa250520784b, user.id=0068c5af0dd747dbb3cd2f9da2db9aef) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:34.531255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d5f10-f5ba-4541-97dd-5b4754553dde None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:34.532677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b7d5f10-f5ba-4541-97dd-5b4754553dde None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:34.539188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 161/318] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:23:34 2022] GET /identity/v3/role_assignments?user.id=0068c5af0dd747dbb3cd2f9da2db9aef&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=4b79664b5ed44a6f9ce2785fe2729fa1 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:34.896563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da8aa-5f89-4d7a-bef4-394ef34a60ab None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:34.896932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da8aa-5f89-4d7a-bef4-394ef34a60ab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:34.897115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e31da8aa-5f89-4d7a-bef4-394ef34a60ab None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:34.898656 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 158/319] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:34.903916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c185c-79ea-4e4e-b801-80a1eb50ee5d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:34.904204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c185c-79ea-4e4e-b801-80a1eb50ee5d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:34.904477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c45c185c-79ea-4e4e-b801-80a1eb50ee5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:34.911083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:34.923150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c45c185c-79ea-4e4e-b801-80a1eb50ee5d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:34.924336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c45c185c-79ea-4e4e-b801-80a1eb50ee5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:34.994505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 162/320] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:35.017317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31da8aa-5f89-4d7a-bef4-394ef34a60ab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:35.067102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:35.123121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e31da8aa-5f89-4d7a-bef4-394ef34a60ab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:35.158127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20124980-ab26-497d-b37a-6479bd06c0e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:35.158879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124980-ab26-497d-b37a-6479bd06c0e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.159162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124980-ab26-497d-b37a-6479bd06c0e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.159432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20124980-ab26-497d-b37a-6479bd06c0e2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.160579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124980-ab26-497d-b37a-6479bd06c0e2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:35.162042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20124980-ab26-497d-b37a-6479bd06c0e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:35.168194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 159/321] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:35.169705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c185c-79ea-4e4e-b801-80a1eb50ee5d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:35.249920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11cad5-ec61-48d9-a763-ac4a891ddaba None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.250307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11cad5-ec61-48d9-a763-ac4a891ddaba None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.250653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae11cad5-ec61-48d9-a763-ac4a891ddaba None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.252199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 160/322] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:35.256791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26f6e1-eb70-4e4b-8a36-f2480294dbc7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.257072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26f6e1-eb70-4e4b-8a36-f2480294dbc7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.257345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f26f6e1-eb70-4e4b-8a36-f2480294dbc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.268827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c45c185c-79ea-4e4e-b801-80a1eb50ee5d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:35.274716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9f26f6e1-eb70-4e4b-8a36-f2480294dbc7 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:35.276151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9f26f6e1-eb70-4e4b-8a36-f2480294dbc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:35.306424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31529dcd-70bd-443c-a897-43b6a4b3205c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:35.307301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31529dcd-70bd-443c-a897-43b6a4b3205c None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.307739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31529dcd-70bd-443c-a897-43b6a4b3205c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.308213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31529dcd-70bd-443c-a897-43b6a4b3205c None admin] PATH_INFO: `/v3/groups` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.308771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31529dcd-70bd-443c-a897-43b6a4b3205c None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:35.310227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31529dcd-70bd-443c-a897-43b6a4b3205c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:35.314290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:35.329766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 163/323] 10.222.0.20 () {60 vars in 1134 bytes} [Tue Jul 12 08:23:35 2022] POST /identity/v3/groups => generated 226 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:23:35.352005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 161/324] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:35.372403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31529dcd-70bd-443c-a897-43b6a4b3205c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:35.493084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31529dcd-70bd-443c-a897-43b6a4b3205c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:35.540371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873148a9-2593-4231-bf15-e7f344f2aeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:35.541167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873148a9-2593-4231-bf15-e7f344f2aeef None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.541575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873148a9-2593-4231-bf15-e7f344f2aeef None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.541887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873148a9-2593-4231-bf15-e7f344f2aeef None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.553589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873148a9-2593-4231-bf15-e7f344f2aeef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-873148a9-2593-4231-bf15-e7f344f2aeef None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:35.561533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:35.562425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:35.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 164/325] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:35.569626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26f6e1-eb70-4e4b-8a36-f2480294dbc7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:35.621463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:35.680241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f26f6e1-eb70-4e4b-8a36-f2480294dbc7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:35.718586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:35.719540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.720018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.720459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.721368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:35.721862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:35.723424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:35.732437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 162/326] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:35.738649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873148a9-2593-4231-bf15-e7f344f2aeef None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:35.810422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:35.868977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873148a9-2593-4231-bf15-e7f344f2aeef None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:35.911795 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1e69a8-6830-4cfa-8e33-773328211a9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:35.913088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e69a8-6830-4cfa-8e33-773328211a9a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.913626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e69a8-6830-4cfa-8e33-773328211a9a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.914092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1e69a8-6830-4cfa-8e33-773328211a9a None admin] PATH_INFO: `/v3/users/2a9f2d3b4d0c400cbc54ce34433cfadd` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.915560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e69a8-6830-4cfa-8e33-773328211a9a None admin] RBAC: Authorizing `identity:get_user(user_id=2a9f2d3b4d0c400cbc54ce34433cfadd)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:35.917204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1e69a8-6830-4cfa-8e33-773328211a9a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:35.919131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 165/327] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:35 2022] GET /identity/v3/users/2a9f2d3b4d0c400cbc54ce34433cfadd => generated 293 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:35.926650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:35.940358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3ee0-9738-46f3-a637-f93dc233ded0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.940636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3ee0-9738-46f3-a637-f93dc233ded0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.940833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57c3ee0-9738-46f3-a637-f93dc233ded0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.942524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 166/328] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:35.949058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4857d-38d0-4b89-8423-cf5ad8939d21 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:35.949058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4857d-38d0-4b89-8423-cf5ad8939d21 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:35.949058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e4857d-38d0-4b89-8423-cf5ad8939d21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:35.965517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-52e4857d-38d0-4b89-8423-cf5ad8939d21 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:35.966720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-52e4857d-38d0-4b89-8423-cf5ad8939d21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:36.062764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 167/329] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:36.086817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20158fbb-15e4-4bb7-bde8-e3f7a199484c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:36.096374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4857d-38d0-4b89-8423-cf5ad8939d21 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:36.100970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:36.162471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b861e-b000-46c3-8ab0-127d7f81f0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:36.164075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b861e-b000-46c3-8ab0-127d7f81f0da None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:36.164075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b861e-b000-46c3-8ab0-127d7f81f0da None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:36.164343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b861e-b000-46c3-8ab0-127d7f81f0da None admin] PATH_INFO: `/v3/system/users/2a9f2d3b4d0c400cbc54ce34433cfadd/roles/4b79664b5ed44a6f9ce2785fe2729fa1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:36.166162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b861e-b000-46c3-8ab0-127d7f81f0da None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=2a9f2d3b4d0c400cbc54ce34433cfadd, role_id=4b79664b5ed44a6f9ce2785fe2729fa1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:36.168158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e93b861e-b000-46c3-8ab0-127d7f81f0da None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:36.174083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:36.184634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 163/330] 10.222.0.20 () {58 vars in 1334 bytes} [Tue Jul 12 08:23:35 2022] PUT /identity/v3/system/users/2a9f2d3b4d0c400cbc54ce34433cfadd/roles/4b79664b5ed44a6f9ce2785fe2729fa1 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:36.232733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e4857d-38d0-4b89-8423-cf5ad8939d21 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:36.272776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a027891-6a34-4d89-9429-cab74ff50336 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:36.273992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027891-6a34-4d89-9429-cab74ff50336 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:36.274468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027891-6a34-4d89-9429-cab74ff50336 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:36.275046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a027891-6a34-4d89-9429-cab74ff50336 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:36.288945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a027891-6a34-4d89-9429-cab74ff50336 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1a027891-6a34-4d89-9429-cab74ff50336 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:36.298077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:36.299048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:36.299863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:36.302816 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 168/331] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:36.308853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b861e-b000-46c3-8ab0-127d7f81f0da None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:36.463573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b861e-b000-46c3-8ab0-127d7f81f0da None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:36.501109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:36.501743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:36.502023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:36.502299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:36.503042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:36.503349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:36.504714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:36.513925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 164/332] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:36.522978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a027891-6a34-4d89-9429-cab74ff50336 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:36.683593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a027891-6a34-4d89-9429-cab74ff50336 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:36.697205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:36.722055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15964b7-ba60-4a1e-8b39-cc2fd582b920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:36.722941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15964b7-ba60-4a1e-8b39-cc2fd582b920 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:36.723221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15964b7-ba60-4a1e-8b39-cc2fd582b920 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:36.723492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15964b7-ba60-4a1e-8b39-cc2fd582b920 None admin] PATH_INFO: `/v3/users/5bd86d8aa2564db9a1a325b33af7154e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:36.724742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15964b7-ba60-4a1e-8b39-cc2fd582b920 None admin] RBAC: Authorizing `identity:get_user(user_id=5bd86d8aa2564db9a1a325b33af7154e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:36.726228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e15964b7-ba60-4a1e-8b39-cc2fd582b920 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:36.728163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 169/333] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:36 2022] GET /identity/v3/users/5bd86d8aa2564db9a1a325b33af7154e => generated 293 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:36.734251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:36.778577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:36.859135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807679b2-9c15-4220-adcb-5fef2c7f046d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:36.895825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb2243-997a-4d6c-be90-917716511c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:36.896481 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2243-997a-4d6c-be90-917716511c25 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:36.896771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2243-997a-4d6c-be90-917716511c25 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:36.897036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb2243-997a-4d6c-be90-917716511c25 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:36.897896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2243-997a-4d6c-be90-917716511c25 None admin] RBAC: Adding query filter params (role.id=672aed7af8e9436a801cd1eca8806cce, user.id=5bd86d8aa2564db9a1a325b33af7154e, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:36.898201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2243-997a-4d6c-be90-917716511c25 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:36.899633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb2243-997a-4d6c-be90-917716511c25 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:36.913132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 165/334] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 12 08:23:36 2022] GET /identity/v3/role_assignments?user.id=5bd86d8aa2564db9a1a325b33af7154e&scope.system=all&role.id=672aed7af8e9436a801cd1eca8806cce => generated 510 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:38.240470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce82c-7512-4874-bc66-bb965a378ada None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:38.240994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce82c-7512-4874-bc66-bb965a378ada None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:38.240994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce82c-7512-4874-bc66-bb965a378ada None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:38.242440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 170/335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:38.248334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cca31-3f44-408a-a213-4f95e8836a38 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:38.249519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cca31-3f44-408a-a213-4f95e8836a38 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:38.249519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3cca31-3f44-408a-a213-4f95e8836a38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:38.267213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eb3cca31-3f44-408a-a213-4f95e8836a38 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:38.268426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eb3cca31-3f44-408a-a213-4f95e8836a38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:38.343854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 166/336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:38.376198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce82c-7512-4874-bc66-bb965a378ada None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:38.514979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce82c-7512-4874-bc66-bb965a378ada None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:38.558041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f315c-dcb1-4f77-8806-e64579e455cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:38.558926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f315c-dcb1-4f77-8806-e64579e455cb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:38.559220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f315c-dcb1-4f77-8806-e64579e455cb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:38.559505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f315c-dcb1-4f77-8806-e64579e455cb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:38.578266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-169f315c-dcb1-4f77-8806-e64579e455cb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-169f315c-dcb1-4f77-8806-e64579e455cb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:38.586164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:38.587029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:38.587829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 171/337] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:38.596245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cca31-3f44-408a-a213-4f95e8836a38 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:38.622237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:38.664058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8515d-eaea-46a4-93b0-110929a1c6ea None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:38.664402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8515d-eaea-46a4-93b0-110929a1c6ea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:38.664614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f8515d-eaea-46a4-93b0-110929a1c6ea None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:38.666012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 172/338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:38.671551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b5ec-43a5-487a-96de-6bee244b4051 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:38.671835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b5ec-43a5-487a-96de-6bee244b4051 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:38.672112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d88b5ec-43a5-487a-96de-6bee244b4051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:38.700479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9d88b5ec-43a5-487a-96de-6bee244b4051 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:38.701785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9d88b5ec-43a5-487a-96de-6bee244b4051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:38.777934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3cca31-3f44-408a-a213-4f95e8836a38 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:38.793805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:38.822761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 173/339] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:38.834533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:38.835736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:38.836262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:38.836780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:38.838354 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:38.838898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:38.841454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:38.861081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 167/340] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:38.866613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b5ec-43a5-487a-96de-6bee244b4051 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:38.890426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:39.010825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d88b5ec-43a5-487a-96de-6bee244b4051 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:39.049081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:39.052295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4f420-2e8d-47da-a106-bc8510f62302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:39.053316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4f420-2e8d-47da-a106-bc8510f62302 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.053838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4f420-2e8d-47da-a106-bc8510f62302 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.054333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4e4f420-2e8d-47da-a106-bc8510f62302 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.081789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8a97c72-dd90-450b-88ee-2d0713f220c1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:39.131739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:39.151896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713973cd-1e39-4218-8af4-29138bf9d186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:39.152715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713973cd-1e39-4218-8af4-29138bf9d186 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.153035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713973cd-1e39-4218-8af4-29138bf9d186 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.153321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713973cd-1e39-4218-8af4-29138bf9d186 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.174097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4f420-2e8d-47da-a106-bc8510f62302 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:39.176062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4e4f420-2e8d-47da-a106-bc8510f62302 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:39.179716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713973cd-1e39-4218-8af4-29138bf9d186 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-713973cd-1e39-4218-8af4-29138bf9d186 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:39.188793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:39.190028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:39.190804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:39.192231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 168/341] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:38 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:39.193885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd80e39-058c-49db-a0b0-21adcd1398df None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.193885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd80e39-058c-49db-a0b0-21adcd1398df None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.194318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfd80e39-058c-49db-a0b0-21adcd1398df None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.202328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 169/342] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:39.202328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd80e39-058c-49db-a0b0-21adcd1398df None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:39.323938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfd80e39-058c-49db-a0b0-21adcd1398df None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:39.361387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-069dfa7e-b476-4e8f-a983-0c6f18c89dab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:39.362436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dfa7e-b476-4e8f-a983-0c6f18c89dab None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.362931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dfa7e-b476-4e8f-a983-0c6f18c89dab None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.363393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-069dfa7e-b476-4e8f-a983-0c6f18c89dab None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.364435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069dfa7e-b476-4e8f-a983-0c6f18c89dab None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:39.364947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069dfa7e-b476-4e8f-a983-0c6f18c89dab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:39.366712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-069dfa7e-b476-4e8f-a983-0c6f18c89dab None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:39.376332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 170/343] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:39 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:39.377919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff45-d4b4-4434-ac06-420c53393aa2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.378401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff45-d4b4-4434-ac06-420c53393aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.378975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c664ff45-d4b4-4434-ac06-420c53393aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.385865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:39.392233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 174/344] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 526 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:39.392932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4f420-2e8d-47da-a106-bc8510f62302 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:39.402498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c664ff45-d4b4-4434-ac06-420c53393aa2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:39.403964 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c664ff45-d4b4-4434-ac06-420c53393aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:39.489079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 171/345] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:39.490285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ff45-d4b4-4434-ac06-420c53393aa2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:39.548498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:39.601069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4e4f420-2e8d-47da-a106-bc8510f62302 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:39.615248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c664ff45-d4b4-4434-ac06-420c53393aa2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:39.651969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9317edf-913a-491e-a2a1-d0ece7725857 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:39.653190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317edf-913a-491e-a2a1-d0ece7725857 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.653689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317edf-913a-491e-a2a1-d0ece7725857 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.654170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9317edf-913a-491e-a2a1-d0ece7725857 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.659413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9317edf-913a-491e-a2a1-d0ece7725857 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:39.661231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9317edf-913a-491e-a2a1-d0ece7725857 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:39.663278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 172/346] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:39 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:39.663472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f6f8919-f3f9-440a-aa40-e8b4babf79f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:39.664129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8919-f3f9-440a-aa40-e8b4babf79f3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.664415 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8919-f3f9-440a-aa40-e8b4babf79f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.664696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f6f8919-f3f9-440a-aa40-e8b4babf79f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.665063 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9317edf-913a-491e-a2a1-d0ece7725857 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:39.679721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:39.788102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f8919-f3f9-440a-aa40-e8b4babf79f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:39.789842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f6f8919-f3f9-440a-aa40-e8b4babf79f3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:39.801292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9317edf-913a-491e-a2a1-d0ece7725857 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:39.847772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020bcf3-fc04-440a-88ce-74802a045298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:39.848726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020bcf3-fc04-440a-88ce-74802a045298 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.849097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020bcf3-fc04-440a-88ce-74802a045298 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.849490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e020bcf3-fc04-440a-88ce-74802a045298 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.864157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e020bcf3-fc04-440a-88ce-74802a045298 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:39.870207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e020bcf3-fc04-440a-88ce-74802a045298 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:39.875735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:39.876699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:39.877756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 173/347] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:39.878855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020bcf3-fc04-440a-88ce-74802a045298 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:39.921539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 175/348] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:39.923414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8fcf7-b2cc-47c5-b454-d583094a390c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:39.924192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8fcf7-b2cc-47c5-b454-d583094a390c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:39.925023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e8fcf7-b2cc-47c5-b454-d583094a390c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:39.927464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 176/349] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:39.933281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8fcf7-b2cc-47c5-b454-d583094a390c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:39.960282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:40.008846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e020bcf3-fc04-440a-88ce-74802a045298 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:40.048156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba38a-2fb6-4fe0-a0c5-4a34cb7f52af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:40.049123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba38a-2fb6-4fe0-a0c5-4a34cb7f52af None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.049505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba38a-2fb6-4fe0-a0c5-4a34cb7f52af None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.049790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9dba38a-2fb6-4fe0-a0c5-4a34cb7f52af None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.055941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dba38a-2fb6-4fe0-a0c5-4a34cb7f52af None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:40.057412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9dba38a-2fb6-4fe0-a0c5-4a34cb7f52af None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:40.059270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 174/350] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:39 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:40.059965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba38a-2fb6-4fe0-a0c5-4a34cb7f52af None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:40.079092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e8fcf7-b2cc-47c5-b454-d583094a390c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:40.119949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e3b179-87c5-4b6f-92c4-f3f2976b8a32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:40.120544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b179-87c5-4b6f-92c4-f3f2976b8a32 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.120823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b179-87c5-4b6f-92c4-f3f2976b8a32 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.121098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e3b179-87c5-4b6f-92c4-f3f2976b8a32 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.121917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b179-87c5-4b6f-92c4-f3f2976b8a32 None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:40.122223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b179-87c5-4b6f-92c4-f3f2976b8a32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:40.123677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e3b179-87c5-4b6f-92c4-f3f2976b8a32 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:40.133981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 177/351] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:40.135199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970185b-6ca2-438c-a4b7-b169b9367e4e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.135492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970185b-6ca2-438c-a4b7-b169b9367e4e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.135768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6970185b-6ca2-438c-a4b7-b169b9367e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.157097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6970185b-6ca2-438c-a4b7-b169b9367e4e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:40.158381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6970185b-6ca2-438c-a4b7-b169b9367e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:40.173576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9dba38a-2fb6-4fe0-a0c5-4a34cb7f52af None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:40.189059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:40.200010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:40.211697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e619d5-96c3-4d0e-9dde-9c09d5977fcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:40.212347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e619d5-96c3-4d0e-9dde-9c09d5977fcf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.212621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e619d5-96c3-4d0e-9dde-9c09d5977fcf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.212888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e619d5-96c3-4d0e-9dde-9c09d5977fcf None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.214122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e619d5-96c3-4d0e-9dde-9c09d5977fcf None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:40.215568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06e619d5-96c3-4d0e-9dde-9c09d5977fcf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:40.218244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 175/352] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:40 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:40.219442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30eaf6-8237-48af-9bc2-50d6be3d3510 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.219724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30eaf6-8237-48af-9bc2-50d6be3d3510 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.219988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc30eaf6-8237-48af-9bc2-50d6be3d3510 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.221560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 176/353] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:40.224893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f51d9-d752-4744-be74-730389d4162d None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.224893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f51d9-d752-4744-be74-730389d4162d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.224893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8f51d9-d752-4744-be74-730389d4162d None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.225822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 177/354] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:40.226556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f51d9-d752-4744-be74-730389d4162d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:40.253562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 178/355] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:40.262395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970185b-6ca2-438c-a4b7-b169b9367e4e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:40.350824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8f51d9-d752-4744-be74-730389d4162d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:40.380588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6970185b-6ca2-438c-a4b7-b169b9367e4e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:40.403252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:40.404020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.404298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.404689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.405595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] RBAC: Adding query filter params (group.id=d1dc0571ceab45b9968834a273dca2a4, role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=f89be6274838409da0aafbfa44983f83) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:40.405904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:40.407463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:40.416506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 178/356] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:40 2022] GET /identity/v3/role_assignments?group.id=d1dc0571ceab45b9968834a273dca2a4&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=672aed7af8e9436a801cd1eca8806cce => generated 260 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:40.420822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:40.441302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff5bbba7-7f69-43a9-aa1a-80851f662002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:40.442044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bbba7-7f69-43a9-aa1a-80851f662002 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.442281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bbba7-7f69-43a9-aa1a-80851f662002 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.442551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff5bbba7-7f69-43a9-aa1a-80851f662002 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.486747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:40.501508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:40.547187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bbba7-7f69-43a9-aa1a-80851f662002 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:40.549182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff5bbba7-7f69-43a9-aa1a-80851f662002 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:40.558473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687df426-2fac-4b50-b627-23aacdf50e5e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:40.600172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e321a022-446b-4e8c-8206-420953133273 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:40.601030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321a022-446b-4e8c-8206-420953133273 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.601309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321a022-446b-4e8c-8206-420953133273 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.601606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e321a022-446b-4e8c-8206-420953133273 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.602785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321a022-446b-4e8c-8206-420953133273 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:40.604214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e321a022-446b-4e8c-8206-420953133273 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:40.605880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 179/357] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:40 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:40.607142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bc0a-c3e7-49f9-824b-29bec968d11d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.607421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bc0a-c3e7-49f9-824b-29bec968d11d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.607693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a94bc0a-c3e7-49f9-824b-29bec968d11d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.627207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7a94bc0a-c3e7-49f9-824b-29bec968d11d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:40.628399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7a94bc0a-c3e7-49f9-824b-29bec968d11d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:40.678971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 179/358] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:40.682204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9049-dc67-48f4-b5a9-5b97d27bc1dc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.682757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9049-dc67-48f4-b5a9-5b97d27bc1dc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.683672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856a9049-dc67-48f4-b5a9-5b97d27bc1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.705000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-856a9049-dc67-48f4-b5a9-5b97d27bc1dc None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:40.706279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-856a9049-dc67-48f4-b5a9-5b97d27bc1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:40.720117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 180/359] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:40.720965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94bc0a-c3e7-49f9-824b-29bec968d11d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:40.786082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:40.800088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 180/360] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:40.800892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a9049-dc67-48f4-b5a9-5b97d27bc1dc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:40.806590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:40.862670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a94bc0a-c3e7-49f9-824b-29bec968d11d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:40.913807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1804f6-b57d-41ff-aff7-ddd8d52464d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:40.913807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1804f6-b57d-41ff-aff7-ddd8d52464d4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.913807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1804f6-b57d-41ff-aff7-ddd8d52464d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.913807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1804f6-b57d-41ff-aff7-ddd8d52464d4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.926909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad1804f6-b57d-41ff-aff7-ddd8d52464d4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:40.928259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856a9049-dc67-48f4-b5a9-5b97d27bc1dc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ad1804f6-b57d-41ff-aff7-ddd8d52464d4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:40.937265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:40.938182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:40.938979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:40.939584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 181/361] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:40.940143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1804f6-b57d-41ff-aff7-ddd8d52464d4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:40.977831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:40.979169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:40.979911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:40.980364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:40.981613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] RBAC: Adding query filter params (group.id=d1dc0571ceab45b9968834a273dca2a4, role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=f89be6274838409da0aafbfa44983f83) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:40.982422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:40.984929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:40.992438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 181/362] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:40 2022] GET /identity/v3/role_assignments?group.id=d1dc0571ceab45b9968834a273dca2a4&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 260 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:40.993544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.072994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:41.084881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1804f6-b57d-41ff-aff7-ddd8d52464d4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.107023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:41.131968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea414a-988f-41c7-a2d1-16cdd682e9c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.132950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea414a-988f-41c7-a2d1-16cdd682e9c4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.133301 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea414a-988f-41c7-a2d1-16cdd682e9c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.133673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdea414a-988f-41c7-a2d1-16cdd682e9c4 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.134997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea414a-988f-41c7-a2d1-16cdd682e9c4 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:41.137722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdea414a-988f-41c7-a2d1-16cdd682e9c4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:41.139900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 182/363] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:40 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:41.140529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea414a-988f-41c7-a2d1-16cdd682e9c4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.145400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf050c9f-a303-4737-afd3-513fe8f964f9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.192977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab276ad-4b30-4632-9dc3-69a543328405 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.193726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab276ad-4b30-4632-9dc3-69a543328405 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.194003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab276ad-4b30-4632-9dc3-69a543328405 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.194268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab276ad-4b30-4632-9dc3-69a543328405 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.207581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ab276ad-4b30-4632-9dc3-69a543328405 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6ab276ad-4b30-4632-9dc3-69a543328405 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:41.215383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:41.216305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 182/364] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:40 2022] GET /identity/v3/roles/reader => generated 84 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:41.218102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab276ad-4b30-4632-9dc3-69a543328405 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.281312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdea414a-988f-41c7-a2d1-16cdd682e9c4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.331808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8975b-2d90-49d4-97db-049af24d74b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.332663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8975b-2d90-49d4-97db-049af24d74b7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.332944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8975b-2d90-49d4-97db-049af24d74b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.333269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e8975b-2d90-49d4-97db-049af24d74b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.353559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e8975b-2d90-49d4-97db-049af24d74b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:41.356938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab276ad-4b30-4632-9dc3-69a543328405 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-20e8975b-2d90-49d4-97db-049af24d74b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:41.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:41.362785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 183/365] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:41.364002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8975b-2d90-49d4-97db-049af24d74b7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.382414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:41.408912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.410263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.410690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.411132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.412030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:41.412478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:41.414820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:41.419971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:41.432466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 183/366] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:41.432466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.499546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e8975b-2d90-49d4-97db-049af24d74b7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.544279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b073f31-cc88-4f99-aa46-677623bff366 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.545634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b073f31-cc88-4f99-aa46-677623bff366 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.546116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b073f31-cc88-4f99-aa46-677623bff366 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.546583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b073f31-cc88-4f99-aa46-677623bff366 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.547996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b073f31-cc88-4f99-aa46-677623bff366 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:41.549972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b073f31-cc88-4f99-aa46-677623bff366 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:41.552272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 184/367] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:41 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:41.553256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b073f31-cc88-4f99-aa46-677623bff366 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.584791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d60f3c0-d963-4d89-b81f-30c95fd17683 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.630777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.632065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.632347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.632624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.633387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:41.633723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:41.635371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:41.648141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 184/368] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:41.648798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.686915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b073f31-cc88-4f99-aa46-677623bff366 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.705185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:41.706965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:41.736478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.737445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.737870 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.738284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.739463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:41.739913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:41.742432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:41.753950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 185/369] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:41.755123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.782062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ef97f47-5df4-4daa-9d8a-4659899dffb6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.828994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b4564-a700-47e9-b2f0-39c2af6befbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.829808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b4564-a700-47e9-b2f0-39c2af6befbd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.830182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b4564-a700-47e9-b2f0-39c2af6befbd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.830550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2b4564-a700-47e9-b2f0-39c2af6befbd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.881165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a9c30b-e2db-4f6e-b2dd-4f831598a919 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:41.909448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b4564-a700-47e9-b2f0-39c2af6befbd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:41.911020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2b4564-a700-47e9-b2f0-39c2af6befbd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:41.918390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:41.919266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:41.919767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:41.920282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:41.921445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] RBAC: Adding query filter params (group.id=d1dc0571ceab45b9968834a273dca2a4, role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=2d273344a1544875bfddfa250520784b) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:41.921961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:41.923630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:41.929556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 186/370] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:41 2022] GET /identity/v3/role_assignments?group.id=d1dc0571ceab45b9968834a273dca2a4&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=672aed7af8e9436a801cd1eca8806cce => generated 260 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:41.930535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:41.957482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:41.995823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:42.026218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 185/371] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:42.027141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b4564-a700-47e9-b2f0-39c2af6befbd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:42.070710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbc7f461-eecf-42a9-9b3b-4e98222084d2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:42.111945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8b037-16d9-4dbc-ba6e-c702f378d272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:42.113297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8b037-16d9-4dbc-ba6e-c702f378d272 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.113806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8b037-16d9-4dbc-ba6e-c702f378d272 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.114273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b8b037-16d9-4dbc-ba6e-c702f378d272 None admin] PATH_INFO: `/v3/users/2a9f2d3b4d0c400cbc54ce34433cfadd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.115779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8b037-16d9-4dbc-ba6e-c702f378d272 None admin] RBAC: Authorizing `identity:get_user(user_id=2a9f2d3b4d0c400cbc54ce34433cfadd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:42.117626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b8b037-16d9-4dbc-ba6e-c702f378d272 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:42.119984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 187/372] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:23:41 2022] GET /identity/v3/users/2a9f2d3b4d0c400cbc54ce34433cfadd => generated 293 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:42.121113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8b037-16d9-4dbc-ba6e-c702f378d272 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:42.141231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2b4564-a700-47e9-b2f0-39c2af6befbd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:42.177857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c565d-ea7a-4cf7-99fb-030da0758e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:42.178658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c565d-ea7a-4cf7-99fb-030da0758e3e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.178835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c565d-ea7a-4cf7-99fb-030da0758e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.179097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-869c565d-ea7a-4cf7-99fb-030da0758e3e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.191367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:42.238627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b8b037-16d9-4dbc-ba6e-c702f378d272 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:42.252140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:42.263817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c565d-ea7a-4cf7-99fb-030da0758e3e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:42.266167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-869c565d-ea7a-4cf7-99fb-030da0758e3e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:42.287349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac200-d7a9-4339-a866-f0a60236868d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:42.288639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac200-d7a9-4339-a866-f0a60236868d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.289121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac200-d7a9-4339-a866-f0a60236868d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.289647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4ac200-d7a9-4339-a866-f0a60236868d None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.294110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ac200-d7a9-4339-a866-f0a60236868d None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:42.296083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4ac200-d7a9-4339-a866-f0a60236868d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:42.298484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 188/373] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:42 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:42.299465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac200-d7a9-4339-a866-f0a60236868d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:42.418978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 186/374] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:42.420078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c565d-ea7a-4cf7-99fb-030da0758e3e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:42.430214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4ac200-d7a9-4339-a866-f0a60236868d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:42.470787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:42.479217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:42.480029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.480316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.480595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.481473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] RBAC: Adding query filter params (role.id=4b79664b5ed44a6f9ce2785fe2729fa1, user.id=2a9f2d3b4d0c400cbc54ce34433cfadd, scope.system=all) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:42.481765 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:42.483726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:42.503408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 189/375] 10.222.0.20 () {56 vars in 1308 bytes} [Tue Jul 12 08:23:42 2022] GET /identity/v3/role_assignments?user.id=2a9f2d3b4d0c400cbc54ce34433cfadd&scope.system=all&role.id=4b79664b5ed44a6f9ce2785fe2729fa1 => generated 510 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:42.503612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:42.567944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:42.575876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-869c565d-ea7a-4cf7-99fb-030da0758e3e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:42.644143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dc3d6-92f4-4a97-9bb4-08679f69d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:42.645938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc3d6-92f4-4a97-9bb4-08679f69d6c0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.646418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc3d6-92f4-4a97-9bb4-08679f69d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.646883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d85dc3d6-92f4-4a97-9bb4-08679f69d6c0 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.650900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dc3d6-92f4-4a97-9bb4-08679f69d6c0 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:42.652671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d85dc3d6-92f4-4a97-9bb4-08679f69d6c0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:42.654905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 187/376] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:42 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:42.662288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dc3d6-92f4-4a97-9bb4-08679f69d6c0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:42.708344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f29a9b7-1a03-462f-97e8-adeec470695b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:42.771064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9aa5866-782f-480f-ba36-7731c23a7ca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:42.772427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa5866-782f-480f-ba36-7731c23a7ca5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.772906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa5866-782f-480f-ba36-7731c23a7ca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.773373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9aa5866-782f-480f-ba36-7731c23a7ca5 None admin] PATH_INFO: `/v3/projects/9d63d9615eff4164ace798b1726ec64c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.775019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa5866-782f-480f-ba36-7731c23a7ca5 None admin] RBAC: Authorizing `identity:get_project(project_id=9d63d9615eff4164ace798b1726ec64c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:42.777004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9aa5866-782f-480f-ba36-7731c23a7ca5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:42.779286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 190/377] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:42 2022] GET /identity/v3/projects/9d63d9615eff4164ace798b1726ec64c => generated 344 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:42.781465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddb2f-10a9-4453-93f7-b6c41e2db09e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.781976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddb2f-10a9-4453-93f7-b6c41e2db09e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.782465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ceddb2f-10a9-4453-93f7-b6c41e2db09e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.783900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 191/378] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:42.787527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddb2f-10a9-4453-93f7-b6c41e2db09e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:42.822438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d85dc3d6-92f4-4a97-9bb4-08679f69d6c0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:42.833868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:42.863261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81821df-07e5-4eaf-821c-2a005b48b719 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:42.863261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81821df-07e5-4eaf-821c-2a005b48b719 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.863800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81821df-07e5-4eaf-821c-2a005b48b719 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.864145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81821df-07e5-4eaf-821c-2a005b48b719 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.865148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81821df-07e5-4eaf-821c-2a005b48b719 None admin] RBAC: Adding query filter params (group.id=d1dc0571ceab45b9968834a273dca2a4, role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=2d273344a1544875bfddfa250520784b) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:42.867013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81821df-07e5-4eaf-821c-2a005b48b719 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:42.867120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81821df-07e5-4eaf-821c-2a005b48b719 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:42.874172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 188/379] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:42 2022] GET /identity/v3/role_assignments?group.id=d1dc0571ceab45b9968834a273dca2a4&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 260 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:42.875597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99025365-f6d5-4323-bacf-fef542d0968e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:42.875953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99025365-f6d5-4323-bacf-fef542d0968e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:42.876302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99025365-f6d5-4323-bacf-fef542d0968e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:42.896132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-99025365-f6d5-4323-bacf-fef542d0968e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:42.898698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-99025365-f6d5-4323-bacf-fef542d0968e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:42.939119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:42.946013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ceddb2f-10a9-4453-93f7-b6c41e2db09e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:43.012988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 189/380] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:43.014818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421ed37-527d-4af6-ab0a-7a7c2b9d0536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:43.015699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421ed37-527d-4af6-ab0a-7a7c2b9d0536 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:43.015978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421ed37-527d-4af6-ab0a-7a7c2b9d0536 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:43.016255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a421ed37-527d-4af6-ab0a-7a7c2b9d0536 None admin] PATH_INFO: `/v3/groups/db66145f73d349f9b817b0d6f7721a8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:43.030752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421ed37-527d-4af6-ab0a-7a7c2b9d0536 None admin] RBAC: Authorizing `identity:get_group(group_id=db66145f73d349f9b817b0d6f7721a8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:43.032309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a421ed37-527d-4af6-ab0a-7a7c2b9d0536 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:43.034346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 192/381] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:42 2022] GET /identity/v3/groups/db66145f73d349f9b817b0d6f7721a8a => generated 229 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:43.040164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99025365-f6d5-4323-bacf-fef542d0968e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:43.054693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421ed37-527d-4af6-ab0a-7a7c2b9d0536 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:43.206568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99025365-f6d5-4323-bacf-fef542d0968e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:43.208518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:43.208741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a421ed37-527d-4af6-ab0a-7a7c2b9d0536 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:43.246182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:43.247191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:43.247436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d0b43-c54c-4cf5-8bc8-74f8ef166725 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:43.247915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:43.248231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d0b43-c54c-4cf5-8bc8-74f8ef166725 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:43.248659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d0b43-c54c-4cf5-8bc8-74f8ef166725 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:43.248850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:43.248944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b5d0b43-c54c-4cf5-8bc8-74f8ef166725 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:43.250005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] RBAC: Adding query filter params (group.id=db66145f73d349f9b817b0d6f7721a8a, role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=9d63d9615eff4164ace798b1726ec64c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:43.250529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:43.252167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:43.258447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 190/382] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:43 2022] GET /identity/v3/role_assignments?group.id=db66145f73d349f9b817b0d6f7721a8a&scope.project.id=9d63d9615eff4164ace798b1726ec64c&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 260 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:43.269702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b5d0b43-c54c-4cf5-8bc8-74f8ef166725 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3b5d0b43-c54c-4cf5-8bc8-74f8ef166725 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:43.277898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:43.278825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:43.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 193/383] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:43.287234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:43.432565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bd34a56-77e0-4c68-b929-254afb665e3e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:43.469469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:43.470078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:43.470355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:43.470903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:43.471651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:43.471952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:43.473313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:43.482512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 191/384] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:43.488545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d0b43-c54c-4cf5-8bc8-74f8ef166725 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:43.517832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:43.594427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b5d0b43-c54c-4cf5-8bc8-74f8ef166725 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:43.630622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323afd4f-de6d-4bfe-aaec-085c84e1fbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:43.631790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323afd4f-de6d-4bfe-aaec-085c84e1fbbb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:43.632248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323afd4f-de6d-4bfe-aaec-085c84e1fbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:43.632694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323afd4f-de6d-4bfe-aaec-085c84e1fbbb None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:43.634041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323afd4f-de6d-4bfe-aaec-085c84e1fbbb None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:43.635665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323afd4f-de6d-4bfe-aaec-085c84e1fbbb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:43.637766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 194/385] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:43 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:43.643630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:43.675783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:43.752960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d33c33-634a-4d3b-b080-377c56185e3a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:43.791841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58dc426b-83c3-441d-a59d-8f930e35943c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:43.793027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc426b-83c3-441d-a59d-8f930e35943c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:43.793524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc426b-83c3-441d-a59d-8f930e35943c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:43.793983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58dc426b-83c3-441d-a59d-8f930e35943c None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:43.795622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc426b-83c3-441d-a59d-8f930e35943c None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:43.797260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58dc426b-83c3-441d-a59d-8f930e35943c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:43.799511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 192/386] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:43 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:43.805257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323afd4f-de6d-4bfe-aaec-085c84e1fbbb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:43.907636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:43.916046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323afd4f-de6d-4bfe-aaec-085c84e1fbbb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:43.956795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dd99413-1fb6-4b9e-8ebf-f0a32c059f6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:43.957702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd99413-1fb6-4b9e-8ebf-f0a32c059f6f None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:43.957981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd99413-1fb6-4b9e-8ebf-f0a32c059f6f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:43.958252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dd99413-1fb6-4b9e-8ebf-f0a32c059f6f None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83/groups/d1dc0571ceab45b9968834a273dca2a4/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:43.960207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd99413-1fb6-4b9e-8ebf-f0a32c059f6f None admin] RBAC: Authorizing `identity:create_grant(project_id=f89be6274838409da0aafbfa44983f83, group_id=d1dc0571ceab45b9968834a273dca2a4, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:43.961671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dd99413-1fb6-4b9e-8ebf-f0a32c059f6f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:43.976475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 195/387] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 12 08:23:43 2022] PUT /identity/v3/projects/f89be6274838409da0aafbfa44983f83/groups/d1dc0571ceab45b9968834a273dca2a4/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:44.110410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2b009-e3f3-4ed4-8065-f44701cb7776 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:44.110780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2b009-e3f3-4ed4-8065-f44701cb7776 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:44.110970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b2b009-e3f3-4ed4-8065-f44701cb7776 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:44.112583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 193/388] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:44.117718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d5b36-e4cd-422f-b289-71d7d6e040f6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:44.118013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d5b36-e4cd-422f-b289-71d7d6e040f6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:44.118289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d5b36-e4cd-422f-b289-71d7d6e040f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:44.138564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-690d5b36-e4cd-422f-b289-71d7d6e040f6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:44.140663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-690d5b36-e4cd-422f-b289-71d7d6e040f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:44.219302 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 196/389] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:44.242516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2b009-e3f3-4ed4-8065-f44701cb7776 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:44.350417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:44.360642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b2b009-e3f3-4ed4-8065-f44701cb7776 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:44.406626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e3691-c55e-4680-9861-52f64fe4416d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:44.407478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e3691-c55e-4680-9861-52f64fe4416d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:44.407757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e3691-c55e-4680-9861-52f64fe4416d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:44.408026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585e3691-c55e-4680-9861-52f64fe4416d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:44.422300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585e3691-c55e-4680-9861-52f64fe4416d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-585e3691-c55e-4680-9861-52f64fe4416d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:44.434655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:44.435542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:44.437162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 194/390] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:44.442415 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d5b36-e4cd-422f-b289-71d7d6e040f6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:44.564190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:44.588950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d5b36-e4cd-422f-b289-71d7d6e040f6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:44.655123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405a2198-21b4-4fa3-b2e4-b5403e6b2132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:44.656456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2198-21b4-4fa3-b2e4-b5403e6b2132 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:44.656745 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2198-21b4-4fa3-b2e4-b5403e6b2132 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:44.657025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405a2198-21b4-4fa3-b2e4-b5403e6b2132 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:44.666160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2198-21b4-4fa3-b2e4-b5403e6b2132 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:44.666516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2198-21b4-4fa3-b2e4-b5403e6b2132 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:44.667952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405a2198-21b4-4fa3-b2e4-b5403e6b2132 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:44.678514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 197/391] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:44.683972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e3691-c55e-4680-9861-52f64fe4416d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:44.767535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6739f-4887-43ac-8013-7aae424a1e85 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:44.767877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6739f-4887-43ac-8013-7aae424a1e85 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:44.768101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d6739f-4887-43ac-8013-7aae424a1e85 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:44.769761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 198/392] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:44.774610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06f95-b057-45e9-8b82-861a0c867fd7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:44.774896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06f95-b057-45e9-8b82-861a0c867fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:44.775174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3c06f95-b057-45e9-8b82-861a0c867fd7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:44.792437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d3c06f95-b057-45e9-8b82-861a0c867fd7 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:44.793675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3c06f95-b057-45e9-8b82-861a0c867fd7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:44.871518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 199/393] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:44.892174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585e3691-c55e-4680-9861-52f64fe4416d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:44.916566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06f95-b057-45e9-8b82-861a0c867fd7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:44.966663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67909638-a5a7-4745-b1eb-bcf53a23f5ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:44.968161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909638-a5a7-4745-b1eb-bcf53a23f5ca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:44.968445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909638-a5a7-4745-b1eb-bcf53a23f5ca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:44.968709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67909638-a5a7-4745-b1eb-bcf53a23f5ca None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:44.974243 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67909638-a5a7-4745-b1eb-bcf53a23f5ca None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:44.975713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67909638-a5a7-4745-b1eb-bcf53a23f5ca None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:44.977701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 195/394] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:44 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:44.983461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67909638-a5a7-4745-b1eb-bcf53a23f5ca None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:45.021788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:45.038776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:45.069973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3c06f95-b057-45e9-8b82-861a0c867fd7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:45.147018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3082-54a8-4b23-bff0-e692d1313e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:45.147809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3082-54a8-4b23-bff0-e692d1313e4b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.148084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3082-54a8-4b23-bff0-e692d1313e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.148349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e3082-54a8-4b23-bff0-e692d1313e4b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.169903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e3082-54a8-4b23-bff0-e692d1313e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0d6e3082-54a8-4b23-bff0-e692d1313e4b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:45.187259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:45.188150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:45.188963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:45.189602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67909638-a5a7-4745-b1eb-bcf53a23f5ca None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:45.191511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 200/395] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:45.197068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3082-54a8-4b23-bff0-e692d1313e4b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:45.260050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a903507-c9ba-4b3c-855a-44be0eabe6c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:45.260968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a903507-c9ba-4b3c-855a-44be0eabe6c5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.261243 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a903507-c9ba-4b3c-855a-44be0eabe6c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.261535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a903507-c9ba-4b3c-855a-44be0eabe6c5 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.266252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a903507-c9ba-4b3c-855a-44be0eabe6c5 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:45.267709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a903507-c9ba-4b3c-855a-44be0eabe6c5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:45.274313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 196/396] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:44 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:45.278907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a903507-c9ba-4b3c-855a-44be0eabe6c5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:45.396237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e3082-54a8-4b23-bff0-e692d1313e4b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:45.436975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:45.437855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.438131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.438585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.439563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:45.440007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:45.441533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:45.451752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 201/397] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:45.452219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:45.459234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:45.491076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:45.507757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a903507-c9ba-4b3c-855a-44be0eabe6c5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:45.585525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb9ef1d-89ac-400a-a1e4-bf41d3dbc849 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:45.623194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b6b30-51d0-4002-a827-d03eb4b0e1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:45.624451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6b30-51d0-4002-a827-d03eb4b0e1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.624948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6b30-51d0-4002-a827-d03eb4b0e1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.625252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f9cc66-43dc-4260-a1fb-592fe12b08d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:45.625662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1b6b30-51d0-4002-a827-d03eb4b0e1c4 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.626373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cc66-43dc-4260-a1fb-592fe12b08d6 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.626723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cc66-43dc-4260-a1fb-592fe12b08d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.627005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f9cc66-43dc-4260-a1fb-592fe12b08d6 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83/groups/d1dc0571ceab45b9968834a273dca2a4/roles/dd9d89d3dbf5451ba6661a3634837e37` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.627661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b6b30-51d0-4002-a827-d03eb4b0e1c4 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:45.629289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1b6b30-51d0-4002-a827-d03eb4b0e1c4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:45.631402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 202/398] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:45 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:45.635209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9cc66-43dc-4260-a1fb-592fe12b08d6 None admin] RBAC: Authorizing `identity:create_grant(project_id=f89be6274838409da0aafbfa44983f83, group_id=d1dc0571ceab45b9968834a273dca2a4, role_id=dd9d89d3dbf5451ba6661a3634837e37)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:45.636909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f9cc66-43dc-4260-a1fb-592fe12b08d6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:45.637977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b6b30-51d0-4002-a827-d03eb4b0e1c4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:45.675078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 197/399] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 12 08:23:45 2022] PUT /identity/v3/projects/f89be6274838409da0aafbfa44983f83/groups/d1dc0571ceab45b9968834a273dca2a4/roles/dd9d89d3dbf5451ba6661a3634837e37 => generated 0 bytes in 396 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:23:45.719726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:45.762320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1b6b30-51d0-4002-a827-d03eb4b0e1c4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:45.801304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37c996-4e40-403b-8145-186e210890bd None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.802293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37c996-4e40-403b-8145-186e210890bd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.802781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca37c996-4e40-403b-8145-186e210890bd None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.804387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 198/400] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:45.806960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7da0-e607-4285-85eb-1187515239b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:45.808119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7da0-e607-4285-85eb-1187515239b7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.809965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40db3e-b9fc-43c3-84dd-b4aee3ef74d6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.810474 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40db3e-b9fc-43c3-84dd-b4aee3ef74d6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.811001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d40db3e-b9fc-43c3-84dd-b4aee3ef74d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.812614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7da0-e607-4285-85eb-1187515239b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.816909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cb7da0-e607-4285-85eb-1187515239b7 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.819545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7da0-e607-4285-85eb-1187515239b7 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:45.826329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cb7da0-e607-4285-85eb-1187515239b7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:45.831136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 203/401] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:45 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:45.835482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7da0-e607-4285-85eb-1187515239b7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:45.837185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9d40db3e-b9fc-43c3-84dd-b4aee3ef74d6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:45.849652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9d40db3e-b9fc-43c3-84dd-b4aee3ef74d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:45.953494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 199/402] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:45.955471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797418-5c68-4a42-8e63-fc546664b674 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.955989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797418-5c68-4a42-8e63-fc546664b674 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.956304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b797418-5c68-4a42-8e63-fc546664b674 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.958290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 200/403] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:45.967675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef614e5-40cd-41f1-a73b-324c8d6cb63e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:45.968549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef614e5-40cd-41f1-a73b-324c8d6cb63e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:45.968999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef614e5-40cd-41f1-a73b-324c8d6cb63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:45.991135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2ef614e5-40cd-41f1-a73b-324c8d6cb63e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:45.992387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2ef614e5-40cd-41f1-a73b-324c8d6cb63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:45.997153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cb7da0-e607-4285-85eb-1187515239b7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:46.042801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:46.051680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588e55-a4f8-4f86-a61a-d799f6ffcb44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:46.053219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588e55-a4f8-4f86-a61a-d799f6ffcb44 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.053692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588e55-a4f8-4f86-a61a-d799f6ffcb44 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.054150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64588e55-a4f8-4f86-a61a-d799f6ffcb44 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b/groups/d1dc0571ceab45b9968834a273dca2a4/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.056767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64588e55-a4f8-4f86-a61a-d799f6ffcb44 None admin] RBAC: Authorizing `identity:create_grant(project_id=2d273344a1544875bfddfa250520784b, group_id=d1dc0571ceab45b9968834a273dca2a4, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:46.058848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64588e55-a4f8-4f86-a61a-d799f6ffcb44 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:46.077461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 201/404] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:46.077461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef614e5-40cd-41f1-a73b-324c8d6cb63e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.093633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 204/405] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 12 08:23:45 2022] PUT /identity/v3/projects/2d273344a1544875bfddfa250520784b/groups/d1dc0571ceab45b9968834a273dca2a4/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:46.101007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588e55-a4f8-4f86-a61a-d799f6ffcb44 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.103148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:46.237615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64588e55-a4f8-4f86-a61a-d799f6ffcb44 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:46.288896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121cfd-b48d-4814-82a8-518e48c37a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:46.290033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121cfd-b48d-4814-82a8-518e48c37a80 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.290462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121cfd-b48d-4814-82a8-518e48c37a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.290878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd121cfd-b48d-4814-82a8-518e48c37a80 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.296108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef614e5-40cd-41f1-a73b-324c8d6cb63e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:46.305486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd121cfd-b48d-4814-82a8-518e48c37a80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-bd121cfd-b48d-4814-82a8-518e48c37a80 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:46.315640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:46.316798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:46.317819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:46.319793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 205/406] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:46.325570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121cfd-b48d-4814-82a8-518e48c37a80 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.353495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35852-a608-45c4-ad40-660002346384 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:46.354688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35852-a608-45c4-ad40-660002346384 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.355084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35852-a608-45c4-ad40-660002346384 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.355859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a35852-a608-45c4-ad40-660002346384 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.370195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a35852-a608-45c4-ad40-660002346384 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-02a35852-a608-45c4-ad40-660002346384 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:46.380443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:46.381597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:46.382616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:46.388721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 202/407] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 311 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:46.390927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35852-a608-45c4-ad40-660002346384 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.397380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:46.473224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd121cfd-b48d-4814-82a8-518e48c37a80 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:46.501810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:46.519398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4baed0c7-d43c-4e66-b041-cbdebf8bbb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:46.520649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baed0c7-d43c-4e66-b041-cbdebf8bbb7d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.521132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baed0c7-d43c-4e66-b041-cbdebf8bbb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.521453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4baed0c7-d43c-4e66-b041-cbdebf8bbb7d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.522533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baed0c7-d43c-4e66-b041-cbdebf8bbb7d None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:46.522846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baed0c7-d43c-4e66-b041-cbdebf8bbb7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:46.524864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4baed0c7-d43c-4e66-b041-cbdebf8bbb7d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:46.528505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a35852-a608-45c4-ad40-660002346384 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:46.537502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 206/408] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:46.539171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a64a-29c0-4317-a801-f980f9bd0c5b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.539657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a64a-29c0-4317-a801-f980f9bd0c5b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.540110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8385a64a-29c0-4317-a801-f980f9bd0c5b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.541874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 207/409] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:46.544869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385a64a-29c0-4317-a801-f980f9bd0c5b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.578008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbc5797-bf83-4f40-b8be-78669aefcda8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:46.578731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc5797-bf83-4f40-b8be-78669aefcda8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.578984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc5797-bf83-4f40-b8be-78669aefcda8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.579302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbc5797-bf83-4f40-b8be-78669aefcda8 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.580013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc5797-bf83-4f40-b8be-78669aefcda8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:46.580321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc5797-bf83-4f40-b8be-78669aefcda8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:46.582035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbc5797-bf83-4f40-b8be-78669aefcda8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:46.591280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 203/410] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:46.592977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9e0eb-be47-4151-99b7-a2a9be8b9d19 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.593270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9e0eb-be47-4151-99b7-a2a9be8b9d19 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.598439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c9e0eb-be47-4151-99b7-a2a9be8b9d19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.617567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-99c9e0eb-be47-4151-99b7-a2a9be8b9d19 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:46.618763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-99c9e0eb-be47-4151-99b7-a2a9be8b9d19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:46.661243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8385a64a-29c0-4317-a801-f980f9bd0c5b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:46.676660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:46.697571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 204/411] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:46.698730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9e0eb-be47-4151-99b7-a2a9be8b9d19 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.709735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9c80f-51f5-4df1-baeb-aa783fe3cb06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:46.710939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c80f-51f5-4df1-baeb-aa783fe3cb06 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.711504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c80f-51f5-4df1-baeb-aa783fe3cb06 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.711998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c9c80f-51f5-4df1-baeb-aa783fe3cb06 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.713579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9c80f-51f5-4df1-baeb-aa783fe3cb06 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:46.715865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c9c80f-51f5-4df1-baeb-aa783fe3cb06 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:46.719646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 208/412] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:46.725784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9c80f-51f5-4df1-baeb-aa783fe3cb06 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.789710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:46.844283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c9e0eb-be47-4151-99b7-a2a9be8b9d19 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:46.852671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c9c80f-51f5-4df1-baeb-aa783fe3cb06 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:46.889862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b96c4f-ce58-48a7-a593-b31aa4401095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:46.890815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96c4f-ce58-48a7-a593-b31aa4401095 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.891166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96c4f-ce58-48a7-a593-b31aa4401095 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.891509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79b96c4f-ce58-48a7-a593-b31aa4401095 None admin] PATH_INFO: `/v3/groups/db66145f73d349f9b817b0d6f7721a8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.893057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b96c4f-ce58-48a7-a593-b31aa4401095 None admin] RBAC: Authorizing `identity:get_group(group_id=db66145f73d349f9b817b0d6f7721a8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:46.894707 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79b96c4f-ce58-48a7-a593-b31aa4401095 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:46.895188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e861d6-877f-45f0-8da2-f1ad4d4e091c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:46.896293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e861d6-877f-45f0-8da2-f1ad4d4e091c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:46.896744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e861d6-877f-45f0-8da2-f1ad4d4e091c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:46.897175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e861d6-877f-45f0-8da2-f1ad4d4e091c None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:46.901601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 205/413] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/groups/db66145f73d349f9b817b0d6f7721a8a => generated 229 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:46.902024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e861d6-877f-45f0-8da2-f1ad4d4e091c None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:46.902566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b96c4f-ce58-48a7-a593-b31aa4401095 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.903829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e861d6-877f-45f0-8da2-f1ad4d4e091c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:46.906810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 209/414] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:46.908396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e861d6-877f-45f0-8da2-f1ad4d4e091c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:46.971366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:47.013755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79b96c4f-ce58-48a7-a593-b31aa4401095 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:47.029292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e861d6-877f-45f0-8da2-f1ad4d4e091c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:47.044324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:47.050428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfb9b2-084b-4143-a16e-73faaf5e9a1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:47.051223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfb9b2-084b-4143-a16e-73faaf5e9a1b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.051926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfb9b2-084b-4143-a16e-73faaf5e9a1b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.052531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23cfb9b2-084b-4143-a16e-73faaf5e9a1b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.064072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23cfb9b2-084b-4143-a16e-73faaf5e9a1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:47.070407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8db3b-f6b1-4beb-93e1-15e3b54b4865 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:47.071486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8db3b-f6b1-4beb-93e1-15e3b54b4865 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.071957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8db3b-f6b1-4beb-93e1-15e3b54b4865 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.072424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c8db3b-f6b1-4beb-93e1-15e3b54b4865 None admin] PATH_INFO: `/v3/projects/9d63d9615eff4164ace798b1726ec64c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-23cfb9b2-084b-4143-a16e-73faaf5e9a1b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:47.072527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:47.073348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:47.074209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:47.077557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 206/415] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/roles/member => generated 84 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:47.078507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfb9b2-084b-4143-a16e-73faaf5e9a1b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:47.079369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8db3b-f6b1-4beb-93e1-15e3b54b4865 None admin] RBAC: Authorizing `identity:get_project(project_id=9d63d9615eff4164ace798b1726ec64c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:47.081053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c8db3b-f6b1-4beb-93e1-15e3b54b4865 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:47.083288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 210/416] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:46 2022] GET /identity/v3/projects/9d63d9615eff4164ace798b1726ec64c => generated 344 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:47.086472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8db3b-f6b1-4beb-93e1-15e3b54b4865 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:47.187724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23cfb9b2-084b-4143-a16e-73faaf5e9a1b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:47.197499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c8db3b-f6b1-4beb-93e1-15e3b54b4865 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:47.218204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:47.222371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba256d93-6c39-43d1-bf0c-85430b92a6dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:47.223328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba256d93-6c39-43d1-bf0c-85430b92a6dd None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.223790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba256d93-6c39-43d1-bf0c-85430b92a6dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.224171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba256d93-6c39-43d1-bf0c-85430b92a6dd None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b/groups/d1dc0571ceab45b9968834a273dca2a4/roles/dd9d89d3dbf5451ba6661a3634837e37` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.226571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba256d93-6c39-43d1-bf0c-85430b92a6dd None admin] RBAC: Authorizing `identity:create_grant(project_id=2d273344a1544875bfddfa250520784b, group_id=d1dc0571ceab45b9968834a273dca2a4, role_id=dd9d89d3dbf5451ba6661a3634837e37)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:47.228128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba256d93-6c39-43d1-bf0c-85430b92a6dd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:47.239507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:47.240422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.240922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.241533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.242493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:47.242969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:47.244513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:47.253717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 207/417] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 12 08:23:47 2022] PUT /identity/v3/projects/2d273344a1544875bfddfa250520784b/groups/d1dc0571ceab45b9968834a273dca2a4/roles/dd9d89d3dbf5451ba6661a3634837e37 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:47.254872 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba256d93-6c39-43d1-bf0c-85430b92a6dd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:47.256462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 211/418] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:47 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:47.267218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:47.318468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:47.366483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba256d93-6c39-43d1-bf0c-85430b92a6dd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:47.405381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea064d6-2fdd-42b5-8c24-8419dad8b5c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:47.406428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea064d6-2fdd-42b5-8c24-8419dad8b5c9 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.406781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea064d6-2fdd-42b5-8c24-8419dad8b5c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.407111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea064d6-2fdd-42b5-8c24-8419dad8b5c9 None admin] PATH_INFO: `/v3/projects/9d63d9615eff4164ace798b1726ec64c/groups/db66145f73d349f9b817b0d6f7721a8a/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.409199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea064d6-2fdd-42b5-8c24-8419dad8b5c9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9d63d9615eff4164ace798b1726ec64c, group_id=db66145f73d349f9b817b0d6f7721a8a, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:47.417388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea064d6-2fdd-42b5-8c24-8419dad8b5c9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:47.432605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 208/419] 10.222.0.20 () {58 vars in 1442 bytes} [Tue Jul 12 08:23:47 2022] PUT /identity/v3/projects/9d63d9615eff4164ace798b1726ec64c/groups/db66145f73d349f9b817b0d6f7721a8a/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:23:47.490260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e95d629-5d3f-48b9-8a92-88faa41fef5d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:47.530980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f144b-8c81-4454-9702-f01621fc7cac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:47.531979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f144b-8c81-4454-9702-f01621fc7cac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.532440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f144b-8c81-4454-9702-f01621fc7cac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.532891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3f144b-8c81-4454-9702-f01621fc7cac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.588643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:47.611210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f144b-8c81-4454-9702-f01621fc7cac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:47.613003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3f144b-8c81-4454-9702-f01621fc7cac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:47.723530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 212/420] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 08:23:47.729781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea064d6-2fdd-42b5-8c24-8419dad8b5c9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:47.861875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea064d6-2fdd-42b5-8c24-8419dad8b5c9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:47.874870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:47.899139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70cb0ffb-d115-43af-aac3-9aa1252c5704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:47.899994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0ffb-d115-43af-aac3-9aa1252c5704 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.900271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0ffb-d115-43af-aac3-9aa1252c5704 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.900806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70cb0ffb-d115-43af-aac3-9aa1252c5704 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.902013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb0ffb-d115-43af-aac3-9aa1252c5704 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:47.903465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70cb0ffb-d115-43af-aac3-9aa1252c5704 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:47.905561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 209/421] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:47 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:47.910964 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f144b-8c81-4454-9702-f01621fc7cac None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:47.936793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c0ca-63e2-4f55-a774-1d7caf77dc9f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.937128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c0ca-63e2-4f55-a774-1d7caf77dc9f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.937343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9142c0ca-63e2-4f55-a774-1d7caf77dc9f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.939044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 210/422] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:23:47.945520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6bcb-9137-47fc-a30c-b7c0406f59f3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:47.945520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6bcb-9137-47fc-a30c-b7c0406f59f3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:47.945520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cef6bcb-9137-47fc-a30c-b7c0406f59f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:47.963973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2cef6bcb-9137-47fc-a30c-b7c0406f59f3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:47.965397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2cef6bcb-9137-47fc-a30c-b7c0406f59f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:48.065766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:48.084516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 211/423] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:48.105178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3f144b-8c81-4454-9702-f01621fc7cac None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:48.109188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6bcb-9137-47fc-a30c-b7c0406f59f3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:48.153371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9c86-9ac6-4d68-90bd-00e58ae88983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:48.155505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9c86-9ac6-4d68-90bd-00e58ae88983 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:48.158602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9c86-9ac6-4d68-90bd-00e58ae88983 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:48.159067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3b9c86-9ac6-4d68-90bd-00e58ae88983 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:48.160659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b9c86-9ac6-4d68-90bd-00e58ae88983 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:48.163289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d3b9c86-9ac6-4d68-90bd-00e58ae88983 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:48.165294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 213/424] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:47 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:48.173804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9c86-9ac6-4d68-90bd-00e58ae88983 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:48.269182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cef6bcb-9137-47fc-a30c-b7c0406f59f3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:48.282742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:48.313837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935309c4-fb9e-4526-8c81-77d555c26dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:48.314938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935309c4-fb9e-4526-8c81-77d555c26dbd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:48.315395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935309c4-fb9e-4526-8c81-77d555c26dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:48.315843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-935309c4-fb9e-4526-8c81-77d555c26dbd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:48.334353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-935309c4-fb9e-4526-8c81-77d555c26dbd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-935309c4-fb9e-4526-8c81-77d555c26dbd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:48.343308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:48.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:48.345017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:48.353870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 212/425] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:48 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:48.360329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935309c4-fb9e-4526-8c81-77d555c26dbd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:48.378134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3b9c86-9ac6-4d68-90bd-00e58ae88983 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:48.433838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-538f6c03-c60f-4e82-ab5b-268d34883f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:48.434497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6c03-c60f-4e82-ab5b-268d34883f0f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:48.434775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6c03-c60f-4e82-ab5b-268d34883f0f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:48.435045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-538f6c03-c60f-4e82-ab5b-268d34883f0f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:48.436473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f6c03-c60f-4e82-ab5b-268d34883f0f None admin] RBAC: Adding query filter params (group.id=d1dc0571ceab45b9968834a273dca2a4, role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=f89be6274838409da0aafbfa44983f83) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:48.436778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f6c03-c60f-4e82-ab5b-268d34883f0f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:48.438333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-538f6c03-c60f-4e82-ab5b-268d34883f0f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:48.444955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 214/426] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:48 2022] GET /identity/v3/role_assignments?group.id=d1dc0571ceab45b9968834a273dca2a4&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=672aed7af8e9436a801cd1eca8806cce => generated 611 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:48.446332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03da4a-898e-4623-bb69-77dcfc659386 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:48.452633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03da4a-898e-4623-bb69-77dcfc659386 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:48.452633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec03da4a-898e-4623-bb69-77dcfc659386 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:48.452633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 215/427] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:48.454557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0da3b4-7b6c-4110-9499-92a8f69254a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:48.454557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0da3b4-7b6c-4110-9499-92a8f69254a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:48.454863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0da3b4-7b6c-4110-9499-92a8f69254a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:48.486409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cd0da3b4-7b6c-4110-9499-92a8f69254a4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:48.487666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cd0da3b4-7b6c-4110-9499-92a8f69254a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:48.498958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:48.585994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-935309c4-fb9e-4526-8c81-77d555c26dbd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:48.631238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 216/428] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:48.655603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:48.656619 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:48.657121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:48.657677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:48.658632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:48.658752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0da3b4-7b6c-4110-9499-92a8f69254a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:48.659253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:48.661086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:48.674000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 213/429] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:48.682285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:48.724373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:48.798712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0da3b4-7b6c-4110-9499-92a8f69254a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:48.829377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ec9ef6-f8bd-4709-8568-e14015c07988 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:48.865102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef20db-0d72-46d5-96c2-b324ee4e94ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:48.865942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef20db-0d72-46d5-96c2-b324ee4e94ea None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:48.866217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef20db-0d72-46d5-96c2-b324ee4e94ea None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:48.866485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ef20db-0d72-46d5-96c2-b324ee4e94ea None admin] PATH_INFO: `/v3/roles/member` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:48.877969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552507f-a091-4575-bd89-68c8ab14928d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:48.878508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ef20db-0d72-46d5-96c2-b324ee4e94ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:48.878749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552507f-a091-4575-bd89-68c8ab14928d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:48.878914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552507f-a091-4575-bd89-68c8ab14928d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:48.879190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552507f-a091-4575-bd89-68c8ab14928d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-23ef20db-0d72-46d5-96c2-b324ee4e94ea None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:48.887269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:48.888198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:48.889783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 217/430] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:48.901704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef20db-0d72-46d5-96c2-b324ee4e94ea None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:48.906418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:48.960723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552507f-a091-4575-bd89-68c8ab14928d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:48.962150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552507f-a091-4575-bd89-68c8ab14928d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:48.993811 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:49.026739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ef20db-0d72-46d5-96c2-b324ee4e94ea None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:49.064621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:49.065385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.065793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.066079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.066839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:49.067142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:49.068537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:49.069255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 214/431] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 390 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:49.074978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552507f-a091-4575-bd89-68c8ab14928d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:49.084898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 218/432] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:23:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:49.090313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:49.166406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:49.203061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552507f-a091-4575-bd89-68c8ab14928d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:49.213320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dac6b22a-e3ab-4441-8cd3-4cd13dc298c9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:49.239209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:49.245224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdbd25-abe8-4746-ae30-f6cecf9f9a57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:49.246345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdbd25-abe8-4746-ae30-f6cecf9f9a57 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.246800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdbd25-abe8-4746-ae30-f6cecf9f9a57 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.247235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46cdbd25-abe8-4746-ae30-f6cecf9f9a57 None admin] PATH_INFO: `/v3/projects/f89be6274838409da0aafbfa44983f83` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.248942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdbd25-abe8-4746-ae30-f6cecf9f9a57 None admin] RBAC: Authorizing `identity:get_project(project_id=f89be6274838409da0aafbfa44983f83)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:49.250706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46cdbd25-abe8-4746-ae30-f6cecf9f9a57 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:49.252632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 215/433] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:49 2022] GET /identity/v3/projects/f89be6274838409da0aafbfa44983f83 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:49.258888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdbd25-abe8-4746-ae30-f6cecf9f9a57 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:49.270782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290932fe-fba3-4114-bd0c-b1b25d0cfcb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:49.271449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290932fe-fba3-4114-bd0c-b1b25d0cfcb4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.271729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290932fe-fba3-4114-bd0c-b1b25d0cfcb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.271993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290932fe-fba3-4114-bd0c-b1b25d0cfcb4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.361379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290932fe-fba3-4114-bd0c-b1b25d0cfcb4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:49.363231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290932fe-fba3-4114-bd0c-b1b25d0cfcb4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:49.398589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46cdbd25-abe8-4746-ae30-f6cecf9f9a57 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:49.439276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:49.445555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b761-7d2e-4536-ba97-14aea03ab5f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:49.449581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b761-7d2e-4536-ba97-14aea03ab5f8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.449581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b761-7d2e-4536-ba97-14aea03ab5f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.449581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd3b761-7d2e-4536-ba97-14aea03ab5f8 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.449581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3b761-7d2e-4536-ba97-14aea03ab5f8 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:49.450362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd3b761-7d2e-4536-ba97-14aea03ab5f8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:49.453365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 216/434] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:49 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:49.459072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b761-7d2e-4536-ba97-14aea03ab5f8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:49.492871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 219/435] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:49 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:49.505444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290932fe-fba3-4114-bd0c-b1b25d0cfcb4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:49.543686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:49.582699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd3b761-7d2e-4536-ba97-14aea03ab5f8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:49.602490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290932fe-fba3-4114-bd0c-b1b25d0cfcb4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:49.620598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:49.621666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.622085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.622496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.623588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] RBAC: Adding query filter params (group.id=d1dc0571ceab45b9968834a273dca2a4, role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=f89be6274838409da0aafbfa44983f83) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:49.624138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:49.625862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:49.633285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 217/436] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:49 2022] GET /identity/v3/role_assignments?group.id=d1dc0571ceab45b9968834a273dca2a4&scope.project.id=f89be6274838409da0aafbfa44983f83&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 611 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:49.647018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccca5d-04a6-4e92-8a8d-664b9e7e073c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:49.648165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccca5d-04a6-4e92-8a8d-664b9e7e073c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.648618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccca5d-04a6-4e92-8a8d-664b9e7e073c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.649029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ccca5d-04a6-4e92-8a8d-664b9e7e073c None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.650917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccca5d-04a6-4e92-8a8d-664b9e7e073c None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:49.652603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ccca5d-04a6-4e92-8a8d-664b9e7e073c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:49.659892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 220/437] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:49 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:49.662805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:49.779864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36083c10-8c7f-4c7f-8247-d7139cfbc4ae None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:49.811460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:49.817203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-263d82a3-621b-407a-8c4b-ba106c438058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:49.818261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d82a3-621b-407a-8c4b-ba106c438058 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.818715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d82a3-621b-407a-8c4b-ba106c438058 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.818986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-263d82a3-621b-407a-8c4b-ba106c438058 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.820161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d82a3-621b-407a-8c4b-ba106c438058 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:49.821671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-263d82a3-621b-407a-8c4b-ba106c438058 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:49.825549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 218/438] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:49 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:49.830818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccca5d-04a6-4e92-8a8d-664b9e7e073c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:49.864862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4768-1b04-4349-8312-9d732f55f3f5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.865443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4768-1b04-4349-8312-9d732f55f3f5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.865549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:49.866007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cbb4768-1b04-4349-8312-9d732f55f3f5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.868397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 219/439] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:49.875399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c0e2-bf14-49cc-a6a5-385b7e84f6bf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.875684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c0e2-bf14-49cc-a6a5-385b7e84f6bf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.875954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3c9c0e2-bf14-49cc-a6a5-385b7e84f6bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.895174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a3c9c0e2-bf14-49cc-a6a5-385b7e84f6bf None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:49.896388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a3c9c0e2-bf14-49cc-a6a5-385b7e84f6bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:49.950339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ccca5d-04a6-4e92-8a8d-664b9e7e073c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:49.979440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 220/440] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:49.980970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a5f5-20db-4f3d-8904-a43f548ce1b7 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.981402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a5f5-20db-4f3d-8904-a43f548ce1b7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.981818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf5a5f5-20db-4f3d-8904-a43f548ce1b7 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.984169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 221/441] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:49.989802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dfee-663e-4c87-b1c0-c928e543b391 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.990132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dfee-663e-4c87-b1c0-c928e543b391 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.990766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f744dfee-663e-4c87-b1c0-c928e543b391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.994982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:49.995643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:49.996042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:49.996315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:49.997471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] RBAC: Adding query filter params (group.id=d1dc0571ceab45b9968834a273dca2a4, role.id=672aed7af8e9436a801cd1eca8806cce, scope.project.id=2d273344a1544875bfddfa250520784b) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:49.997716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:49.999204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:50.008837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f744dfee-663e-4c87-b1c0-c928e543b391 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:50.009736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 221/442] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:49 2022] GET /identity/v3/role_assignments?group.id=d1dc0571ceab45b9968834a273dca2a4&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=672aed7af8e9436a801cd1eca8806cce => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:50.010075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f744dfee-663e-4c87-b1c0-c928e543b391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:50.010542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.115615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 222/443] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:50.141295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744dfee-663e-4c87-b1c0-c928e543b391 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.146260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:50.153450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968d35d5-cd20-4a7d-acc0-3c4cfac73ae9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.194191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b933-dfc6-4c01-9cdd-fee624c19082 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.195046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b933-dfc6-4c01-9cdd-fee624c19082 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.195462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b933-dfc6-4c01-9cdd-fee624c19082 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.195710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de57b933-dfc6-4c01-9cdd-fee624c19082 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.210228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de57b933-dfc6-4c01-9cdd-fee624c19082 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:50.214365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-de57b933-dfc6-4c01-9cdd-fee624c19082 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:50.219269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:50.220154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:50.220967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 222/444] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:50.227116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b933-dfc6-4c01-9cdd-fee624c19082 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.264895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f744dfee-663e-4c87-b1c0-c928e543b391 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.304974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ee46b-f4b6-4775-8ec1-272ce313ebe9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.305710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ee46b-f4b6-4775-8ec1-272ce313ebe9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.305985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ee46b-f4b6-4775-8ec1-272ce313ebe9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.306258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-057ee46b-f4b6-4775-8ec1-272ce313ebe9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.320226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-057ee46b-f4b6-4775-8ec1-272ce313ebe9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-057ee46b-f4b6-4775-8ec1-272ce313ebe9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:50.328459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:50.329465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:23:50.330255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:50.330843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 223/445] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:50.336439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ee46b-f4b6-4775-8ec1-272ce313ebe9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.346663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de57b933-dfc6-4c01-9cdd-fee624c19082 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.387403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.387996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.388274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.388547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.389700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:50.390007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:50.391395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:50.399622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 223/446] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:50.406084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.425534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:50.443598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-057ee46b-f4b6-4775-8ec1-272ce313ebe9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.462931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:50.478104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.478758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.479035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.479306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.480043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:50.480343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:50.481757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:50.489856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 224/447] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:50.495315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.504920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9612ddb2-b29f-4b0b-955f-507fe9e9d7f1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.539271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862034d-b0f6-450f-8327-b461fd78f165 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.539910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862034d-b0f6-450f-8327-b461fd78f165 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.540195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862034d-b0f6-450f-8327-b461fd78f165 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.540475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b862034d-b0f6-450f-8327-b461fd78f165 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.593984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3c8bf4-521a-450e-8102-c2cca31bb4b2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.607775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862034d-b0f6-450f-8327-b461fd78f165 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:50.609231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b862034d-b0f6-450f-8327-b461fd78f165 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:50.627201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:50.627748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3a9b4-c44a-41ee-b92b-498895faf179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.628421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3a9b4-c44a-41ee-b92b-498895faf179 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.628775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3a9b4-c44a-41ee-b92b-498895faf179 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.629083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ec3a9b4-c44a-41ee-b92b-498895faf179 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.677658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:50.697268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3a9b4-c44a-41ee-b92b-498895faf179 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:50.698771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ec3a9b4-c44a-41ee-b92b-498895faf179 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:50.706946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 224/448] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 08:23:50.712467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862034d-b0f6-450f-8327-b461fd78f165 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.801080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 225/449] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 12 08:23:50.806272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b862034d-b0f6-450f-8327-b461fd78f165 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.806570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3a9b4-c44a-41ee-b92b-498895faf179 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.824214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:50.840580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaaf9b-d3dc-443f-a855-8ac2bc3fb678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.841437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaaf9b-d3dc-443f-a855-8ac2bc3fb678 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.841730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaaf9b-d3dc-443f-a855-8ac2bc3fb678 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.842222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98aaaf9b-d3dc-443f-a855-8ac2bc3fb678 None admin] PATH_INFO: `/v3/projects/2d273344a1544875bfddfa250520784b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.843402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aaaf9b-d3dc-443f-a855-8ac2bc3fb678 None admin] RBAC: Authorizing `identity:get_project(project_id=2d273344a1544875bfddfa250520784b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:50.844840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98aaaf9b-d3dc-443f-a855-8ac2bc3fb678 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:50.846546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 225/450] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/projects/2d273344a1544875bfddfa250520784b => generated 302 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:50.852019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaaf9b-d3dc-443f-a855-8ac2bc3fb678 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.884092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:50.903320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ec3a9b4-c44a-41ee-b92b-498895faf179 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.936473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2beb7-e863-4055-b65e-f2da3b27316d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.937249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2beb7-e863-4055-b65e-f2da3b27316d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.937561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2beb7-e863-4055-b65e-f2da3b27316d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.937833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4a2beb7-e863-4055-b65e-f2da3b27316d None admin] PATH_INFO: `/v3/projects/9d63d9615eff4164ace798b1726ec64c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.939011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2beb7-e863-4055-b65e-f2da3b27316d None admin] RBAC: Authorizing `identity:get_project(project_id=9d63d9615eff4164ace798b1726ec64c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:50.940439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4a2beb7-e863-4055-b65e-f2da3b27316d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:50.942161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 226/451] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/projects/9d63d9615eff4164ace798b1726ec64c => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:50.947451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2beb7-e863-4055-b65e-f2da3b27316d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:50.948766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98aaaf9b-d3dc-443f-a855-8ac2bc3fb678 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:50.982264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3cc65-d8df-426e-8468-07d466779570 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:50.983308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3cc65-d8df-426e-8468-07d466779570 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:50.983583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3cc65-d8df-426e-8468-07d466779570 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:50.983852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd3cc65-d8df-426e-8468-07d466779570 None admin] PATH_INFO: `/v3/groups/d1dc0571ceab45b9968834a273dca2a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:50.985006 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3cc65-d8df-426e-8468-07d466779570 None admin] RBAC: Authorizing `identity:get_group(group_id=d1dc0571ceab45b9968834a273dca2a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:50.986461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd3cc65-d8df-426e-8468-07d466779570 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:50.988055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 226/452] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/groups/d1dc0571ceab45b9968834a273dca2a4 => generated 226 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:50.993656 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3cc65-d8df-426e-8468-07d466779570 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:51.047492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4a2beb7-e863-4055-b65e-f2da3b27316d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:51.047889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:51.081499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898191d-f606-41ce-b52d-fe097736ff29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:51.082338 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898191d-f606-41ce-b52d-fe097736ff29 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:51.082620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898191d-f606-41ce-b52d-fe097736ff29 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:51.082893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f898191d-f606-41ce-b52d-fe097736ff29 None admin] PATH_INFO: `/v3/groups/db66145f73d349f9b817b0d6f7721a8a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:51.084046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898191d-f606-41ce-b52d-fe097736ff29 None admin] RBAC: Authorizing `identity:get_group(group_id=db66145f73d349f9b817b0d6f7721a8a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:51.085505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f898191d-f606-41ce-b52d-fe097736ff29 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:51.087100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 227/453] 10.222.0.20 () {56 vars in 1180 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/groups/db66145f73d349f9b817b0d6f7721a8a => generated 229 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:51.092817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898191d-f606-41ce-b52d-fe097736ff29 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:51.095822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd3cc65-d8df-426e-8468-07d466779570 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:51.111374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:51.130570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cad14-2cf5-45bf-8cec-73b1fb9c32a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:51.131217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cad14-2cf5-45bf-8cec-73b1fb9c32a6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:51.131497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cad14-2cf5-45bf-8cec-73b1fb9c32a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:51.131767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cad14-2cf5-45bf-8cec-73b1fb9c32a6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:51.132593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cad14-2cf5-45bf-8cec-73b1fb9c32a6 None admin] RBAC: Adding query filter params (group.id=d1dc0571ceab45b9968834a273dca2a4, role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=2d273344a1544875bfddfa250520784b) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:51.132902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cad14-2cf5-45bf-8cec-73b1fb9c32a6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:51.134358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cad14-2cf5-45bf-8cec-73b1fb9c32a6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:51.140169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 227/454] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:50 2022] GET /identity/v3/role_assignments?group.id=d1dc0571ceab45b9968834a273dca2a4&scope.project.id=2d273344a1544875bfddfa250520784b&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:51.199363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f898191d-f606-41ce-b52d-fe097736ff29 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:51.235317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a422b42-07eb-4dd5-9695-e9fca585f5bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:51.235972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422b42-07eb-4dd5-9695-e9fca585f5bd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:51.236248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422b42-07eb-4dd5-9695-e9fca585f5bd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:51.236519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a422b42-07eb-4dd5-9695-e9fca585f5bd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:51.237357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a422b42-07eb-4dd5-9695-e9fca585f5bd None admin] RBAC: Adding query filter params (group.id=db66145f73d349f9b817b0d6f7721a8a, role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=9d63d9615eff4164ace798b1726ec64c) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:51.237690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a422b42-07eb-4dd5-9695-e9fca585f5bd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:51.239139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a422b42-07eb-4dd5-9695-e9fca585f5bd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:51.245551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 228/455] 10.222.0.20 () {56 vars in 1376 bytes} [Tue Jul 12 08:23:51 2022] GET /identity/v3/role_assignments?group.id=db66145f73d349f9b817b0d6f7721a8a&scope.project.id=9d63d9615eff4164ace798b1726ec64c&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 611 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:53.882419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f58ce-fe9e-411b-b161-8bcae7efd9d0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:53.882958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f58ce-fe9e-411b-b161-8bcae7efd9d0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:53.882958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778f58ce-fe9e-411b-b161-8bcae7efd9d0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:53.884554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 228/456] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:53.890763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece25076-3988-48bb-b5c4-217ddf7ad388 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:53.891562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece25076-3988-48bb-b5c4-217ddf7ad388 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:53.892041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece25076-3988-48bb-b5c4-217ddf7ad388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:53.918665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ece25076-3988-48bb-b5c4-217ddf7ad388 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:53.919869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ece25076-3988-48bb-b5c4-217ddf7ad388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:54.021863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 229/457] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:54.048527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f58ce-fe9e-411b-b161-8bcae7efd9d0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:54.063015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf938a0-b53d-4b8b-bdf5-ed9aa986dca8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.063620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf938a0-b53d-4b8b-bdf5-ed9aa986dca8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.064094 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf938a0-b53d-4b8b-bdf5-ed9aa986dca8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.066089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 230/458] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:54.070826 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25239d6-ad23-4249-bf54-e46cf0c9ddf2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.071114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25239d6-ad23-4249-bf54-e46cf0c9ddf2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.071823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25239d6-ad23-4249-bf54-e46cf0c9ddf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.091191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a25239d6-ad23-4249-bf54-e46cf0c9ddf2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:54.092565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a25239d6-ad23-4249-bf54-e46cf0c9ddf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:54.101728 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:54.182876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 231/459] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:54.184691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72f2e-3573-46a4-b75b-5f55d2ce6ce0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.185189 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72f2e-3573-46a4-b75b-5f55d2ce6ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.186210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc72f2e-3573-46a4-b75b-5f55d2ce6ce0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.187710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 232/460] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:54.193183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17a2f-fee2-4be2-b72c-562ed558ad8a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.193772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17a2f-fee2-4be2-b72c-562ed558ad8a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.194248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80f17a2f-fee2-4be2-b72c-562ed558ad8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.196914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778f58ce-fe9e-411b-b161-8bcae7efd9d0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:54.212998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-80f17a2f-fee2-4be2-b72c-562ed558ad8a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:54.214727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-80f17a2f-fee2-4be2-b72c-562ed558ad8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:54.231457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:54.261315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:54.262224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.262507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.262785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.276274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:54.278508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:54.300156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 233/461] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:54.305503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:54.306364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:54.307188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:54.307188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:54.307188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:54.307188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:54.307188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 229/462] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:54.307188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:54.311133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f17a2f-fee2-4be2-b72c-562ed558ad8a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:54.398555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:54.434185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80f17a2f-fee2-4be2-b72c-562ed558ad8a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:54.463075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4047691c-44fb-4e70-98bd-6173b80174d8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:54.471370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:54.472032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.472316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.472594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.473713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:54.473713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:54.475022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:54.487549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 234/463] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:54.488435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:54.509779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:54.511392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.511881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.512631 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.530629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:54.532871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:54.557452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:54.558351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:54.559175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:54.559175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:54.559175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:54.559175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:54.563918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 230/464] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 254 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:54.564858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:54.590256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:54.607031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a89c5ac-d10d-4fea-b20a-9104514cdbfc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:54.640256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:54.646903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:54.647693 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.647969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.648236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.660754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:54.662245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:54.672648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c9c465-28ef-440d-9f56-eb112e316c73 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:54.680115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:54.680953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:54.681860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:54.681860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:54.681860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:54.681860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:54.681860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 235/465] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:54.682128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:54.716783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2910e39d-7241-4bd0-83d4-08002dc0900c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:54.717517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910e39d-7241-4bd0-83d4-08002dc0900c None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.717636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910e39d-7241-4bd0-83d4-08002dc0900c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.718059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2910e39d-7241-4bd0-83d4-08002dc0900c None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.718843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910e39d-7241-4bd0-83d4-08002dc0900c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:54.720375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2910e39d-7241-4bd0-83d4-08002dc0900c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:54.749578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 231/466] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:54 2022] POST /identity/v3/users => generated 246 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:54.749578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7687-f359-4659-854c-6ec49fbb1b10 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.749578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7687-f359-4659-854c-6ec49fbb1b10 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.749578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ad7687-f359-4659-854c-6ec49fbb1b10 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.749578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 232/467] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:54.749578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad7687-f359-4659-854c-6ec49fbb1b10 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:54.811993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d25f35-dfaf-4e5e-95a1-60cdf22ec46c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:54.853716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82cdaf21-9f82-45cb-846a-8e868c5ae7c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:54.854413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdaf21-9f82-45cb-846a-8e868c5ae7c4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.854754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdaf21-9f82-45cb-846a-8e868c5ae7c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.855030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cdaf21-9f82-45cb-846a-8e868c5ae7c4 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.855848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdaf21-9f82-45cb-846a-8e868c5ae7c4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:54.856150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdaf21-9f82-45cb-846a-8e868c5ae7c4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:54.858241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82cdaf21-9f82-45cb-846a-8e868c5ae7c4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:54.866371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:54.880981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 236/468] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:54.882832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be389-0381-4975-959b-62b7f978273e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.883148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be389-0381-4975-959b-62b7f978273e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.883489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-341be389-0381-4975-959b-62b7f978273e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.896044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ad7687-f359-4659-854c-6ec49fbb1b10 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:54.906022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-341be389-0381-4975-959b-62b7f978273e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:54.908204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-341be389-0381-4975-959b-62b7f978273e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:54.946324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132287f6-8466-4594-910c-454ac81e354d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:54.947503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132287f6-8466-4594-910c-454ac81e354d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:54.947503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132287f6-8466-4594-910c-454ac81e354d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:54.947751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132287f6-8466-4594-910c-454ac81e354d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:54.948622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132287f6-8466-4594-910c-454ac81e354d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:54.948933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132287f6-8466-4594-910c-454ac81e354d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:54.951434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132287f6-8466-4594-910c-454ac81e354d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:54.965242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:54.966445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 233/469] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:54.967600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132287f6-8466-4594-910c-454ac81e354d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:55.007098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 237/470] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:55.007932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341be389-0381-4975-959b-62b7f978273e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:55.106217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132287f6-8466-4594-910c-454ac81e354d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:55.132120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-341be389-0381-4975-959b-62b7f978273e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:55.144919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e7ade-5e7f-47ed-b77b-fc78dc4bed67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:55.145622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e7ade-5e7f-47ed-b77b-fc78dc4bed67 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.145906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e7ade-5e7f-47ed-b77b-fc78dc4bed67 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.146186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa0e7ade-5e7f-47ed-b77b-fc78dc4bed67 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.146878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e7ade-5e7f-47ed-b77b-fc78dc4bed67 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:55.148309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa0e7ade-5e7f-47ed-b77b-fc78dc4bed67 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:55.157524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:55.172029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ad06d9-b712-4c3f-9e04-65e256c6f288 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:55.172709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad06d9-b712-4c3f-9e04-65e256c6f288 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.172985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad06d9-b712-4c3f-9e04-65e256c6f288 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.173262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ad06d9-b712-4c3f-9e04-65e256c6f288 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.174002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad06d9-b712-4c3f-9e04-65e256c6f288 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:55.174555 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 234/471] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:54 2022] POST /identity/v3/users => generated 248 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:55.175371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e7ade-5e7f-47ed-b77b-fc78dc4bed67 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:55.175479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56ad06d9-b712-4c3f-9e04-65e256c6f288 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:55.202555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 238/472] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:55 2022] POST /identity/v3/users => generated 248 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:55.203927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c26586-2642-4c9a-a932-b12c2f5ac0be None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.204212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c26586-2642-4c9a-a932-b12c2f5ac0be None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.204531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c26586-2642-4c9a-a932-b12c2f5ac0be None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.206470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 239/473] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:55.212159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166278c3-fa5a-404e-b411-dc849ff1682d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.212522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166278c3-fa5a-404e-b411-dc849ff1682d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.212884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-166278c3-fa5a-404e-b411-dc849ff1682d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.233764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-166278c3-fa5a-404e-b411-dc849ff1682d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:55.235171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-166278c3-fa5a-404e-b411-dc849ff1682d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:55.266832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:55.319503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 240/474] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:55.352781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa0e7ade-5e7f-47ed-b77b-fc78dc4bed67 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:55.370881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166278c3-fa5a-404e-b411-dc849ff1682d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:55.392416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:55.393534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.394032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.394528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.413386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:55.415564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:55.440197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:55.441096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:55.441970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:55.441970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:55.441970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:55.441970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:55.444456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 235/475] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:55.450472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:55.506915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:55.522505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-166278c3-fa5a-404e-b411-dc849ff1682d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:55.570041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:55.570710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.570995 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.571270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.572288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:55.574323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:55.582531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8eaf51e-11c8-4e55-a8e5-8c51b67f2101 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:55.583482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.sql.core [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 08:23:55.583482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 08:23:55.583482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [parameters: {'id': '646f016f3fa841bf9404df5ab03c8f5b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 08:23:55.583482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80191) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 12 08:23:55.600913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return ref.to_dict() Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 08:23:55.601931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application yield resource Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise self.value Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application session.commit() Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 08:23:55.602850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.flush() Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application compat.raise_( Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 08:23:55.603797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 08:23:55.604673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 08:23:55.607038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [parameters: {'id': '646f016f3fa841bf9404df5ab03c8f5b', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:55.610021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 12 08:23:55.612193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:55.615557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 241/476] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 12 08:23:55 2022] POST /identity/v3/roles => generated 144 bytes in 232 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:23:55.615557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:55.645831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:55.648312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:55.649239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.650851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.651348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.652299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:55.652841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:55.655138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:55.678604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 236/477] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:55.683901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:55.728799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-461fa418-91d9-4808-b522-7b7751f3ea31 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:55.768699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029eac38-5f87-47b2-8c90-d261283bf913 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:55.769883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029eac38-5f87-47b2-8c90-d261283bf913 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.770395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029eac38-5f87-47b2-8c90-d261283bf913 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.770879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-029eac38-5f87-47b2-8c90-d261283bf913 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.782337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-029eac38-5f87-47b2-8c90-d261283bf913 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-029eac38-5f87-47b2-8c90-d261283bf913 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:55.792358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:55.793265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 12 08:23:55.794097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:55.797124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 242/478] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:23:55 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:55.804960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029eac38-5f87-47b2-8c90-d261283bf913 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:55.907015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34f4e7b-1b24-4e8a-beea-6b7b2f3804e6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:55.917011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:55.960520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:55.973704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ff22b6-b75a-484f-9142-61fa9133fbdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:55.974378 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff22b6-b75a-484f-9142-61fa9133fbdf None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:55.974654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff22b6-b75a-484f-9142-61fa9133fbdf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:55.974924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ff22b6-b75a-484f-9142-61fa9133fbdf None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:55.975633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff22b6-b75a-484f-9142-61fa9133fbdf None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:55.977287 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86ff22b6-b75a-484f-9142-61fa9133fbdf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:55.991554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-029eac38-5f87-47b2-8c90-d261283bf913 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:56.018837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 237/479] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:23:55 2022] POST /identity/v3/users => generated 249 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:23:56.038059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989a5509-0876-409d-a6de-2cbd11b3ada9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:56.038726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5509-0876-409d-a6de-2cbd11b3ada9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:56.039003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5509-0876-409d-a6de-2cbd11b3ada9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:56.039273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989a5509-0876-409d-a6de-2cbd11b3ada9 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:56.040030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a5509-0876-409d-a6de-2cbd11b3ada9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:56.040329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a5509-0876-409d-a6de-2cbd11b3ada9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:56.041803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989a5509-0876-409d-a6de-2cbd11b3ada9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:56.056864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 243/480] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:23:55 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:23:57.195591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba22f-6fdc-45f4-9952-7b06445b95c8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.196103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba22f-6fdc-45f4-9952-7b06445b95c8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.196178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09ba22f-6fdc-45f4-9952-7b06445b95c8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.197807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 238/481] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:57.203249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d466fb-fb0b-4901-9583-fbafac84e096 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.203685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d466fb-fb0b-4901-9583-fbafac84e096 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.203876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57d466fb-fb0b-4901-9583-fbafac84e096 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.221634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-57d466fb-fb0b-4901-9583-fbafac84e096 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:57.222857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-57d466fb-fb0b-4901-9583-fbafac84e096 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:57.303671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 244/482] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:57.344460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ba22f-6fdc-45f4-9952-7b06445b95c8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:57.477905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09ba22f-6fdc-45f4-9952-7b06445b95c8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:57.516037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea775045-47fe-4069-a8f5-bf79ff4cf624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:57.516844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775045-47fe-4069-a8f5-bf79ff4cf624 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.517127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775045-47fe-4069-a8f5-bf79ff4cf624 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.517407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea775045-47fe-4069-a8f5-bf79ff4cf624 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.528313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea775045-47fe-4069-a8f5-bf79ff4cf624 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ea775045-47fe-4069-a8f5-bf79ff4cf624 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:57.536612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:57.537527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:57.538761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 239/483] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:23:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:57.543923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d466fb-fb0b-4901-9583-fbafac84e096 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:57.631056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:57.661822 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57d466fb-fb0b-4901-9583-fbafac84e096 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:57.706305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3322afe1-f4ac-47a7-a022-3219c895f401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:57.707049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322afe1-f4ac-47a7-a022-3219c895f401 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.707337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322afe1-f4ac-47a7-a022-3219c895f401 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.707614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3322afe1-f4ac-47a7-a022-3219c895f401 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.708373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322afe1-f4ac-47a7-a022-3219c895f401 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:57.708687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322afe1-f4ac-47a7-a022-3219c895f401 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:57.710138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3322afe1-f4ac-47a7-a022-3219c895f401 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:57.719216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 245/484] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:23:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:57.724643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea775045-47fe-4069-a8f5-bf79ff4cf624 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:57.752375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:57.800302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54753031-a86e-4764-979b-e0967a494277 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.800617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54753031-a86e-4764-979b-e0967a494277 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.800853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54753031-a86e-4764-979b-e0967a494277 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.802407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 246/485] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:57.807072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1275c-e30c-4eed-a02f-b1ca6e811676 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.807577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1275c-e30c-4eed-a02f-b1ca6e811676 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.808069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f1275c-e30c-4eed-a02f-b1ca6e811676 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.835518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea775045-47fe-4069-a8f5-bf79ff4cf624 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:57.850414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-13f1275c-e30c-4eed-a02f-b1ca6e811676 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:57.851912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-13f1275c-e30c-4eed-a02f-b1ca6e811676 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:57.874941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb70109b-dc94-41f0-9b5c-3fb2198a25ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:57.875746 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70109b-dc94-41f0-9b5c-3fb2198a25ef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.876028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70109b-dc94-41f0-9b5c-3fb2198a25ef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.876301 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb70109b-dc94-41f0-9b5c-3fb2198a25ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.899636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70109b-dc94-41f0-9b5c-3fb2198a25ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:57.901632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb70109b-dc94-41f0-9b5c-3fb2198a25ef None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-eb70109b-dc94-41f0-9b5c-3fb2198a25ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:57.924460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:57.925352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:57.926216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:57.926216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:57.926216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:57.926216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:57.926951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 240/486] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:57.928036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5e00-feaf-4b3e-b2af-4c152fc4485a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.928325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5e00-feaf-4b3e-b2af-4c152fc4485a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.928600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7b5e00-feaf-4b3e-b2af-4c152fc4485a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.930116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 241/487] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:57.934246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b5e00-feaf-4b3e-b2af-4c152fc4485a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:57.957202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 247/488] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:57.958531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da90b-162d-4cc6-93c2-5bdd2dc09363 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:57.958821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da90b-162d-4cc6-93c2-5bdd2dc09363 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:57.959101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88da90b-162d-4cc6-93c2-5bdd2dc09363 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:57.977554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b88da90b-162d-4cc6-93c2-5bdd2dc09363 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:57.978729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b88da90b-162d-4cc6-93c2-5bdd2dc09363 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:58.034716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:58.055933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:58.062201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 248/489] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:58.070404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88da90b-162d-4cc6-93c2-5bdd2dc09363 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.075821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7b5e00-feaf-4b3e-b2af-4c152fc4485a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.117451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.118121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.118405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.119400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.119400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:58.119685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:58.121046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:58.134659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 242/490] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:58.135607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.203086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88da90b-162d-4cc6-93c2-5bdd2dc09363 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.239592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10fc85-6494-48fc-8a52-f5e14da62914 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.241161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10fc85-6494-48fc-8a52-f5e14da62914 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.241668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10fc85-6494-48fc-8a52-f5e14da62914 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.242129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f10fc85-6494-48fc-8a52-f5e14da62914 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.247531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25fd2f74-e221-4c4f-aba9-751f16699915 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.254194 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f10fc85-6494-48fc-8a52-f5e14da62914 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8f10fc85-6494-48fc-8a52-f5e14da62914 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:58.262206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:58.263098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:23:58.263988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:58.271802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 249/491] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:58.272974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10fc85-6494-48fc-8a52-f5e14da62914 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.287070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4027-b47d-4b15-ba80-7d15ca126ca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.287932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4027-b47d-4b15-ba80-7d15ca126ca9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.288338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4027-b47d-4b15-ba80-7d15ca126ca9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.288632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c1b4027-b47d-4b15-ba80-7d15ca126ca9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.290769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:58.304221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c1b4027-b47d-4b15-ba80-7d15ca126ca9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1c1b4027-b47d-4b15-ba80-7d15ca126ca9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:58.314617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:58.315550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:58.316360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 243/492] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:58.317011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4027-b47d-4b15-ba80-7d15ca126ca9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.343437 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:58.390342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f10fc85-6494-48fc-8a52-f5e14da62914 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.435341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.436268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.436545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.436856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.445498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:58.446870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:58.451807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c1b4027-b47d-4b15-ba80-7d15ca126ca9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:23:58.464240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:58.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:58.466325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 250/493] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:58.467706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.492310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.493330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.493850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.494349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.495472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:58.495971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:58.497682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:58.506999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 244/494] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:58.508109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.570645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:58.584101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c6950c7-9145-4d60-bfc8-f3ea2559e843 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.603021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:58.617964 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0fb9cdf-e52a-42dc-b2c6-db3740c7be3c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.624123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.624799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.625086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.625362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.626154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:58.626844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:58.627937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:58.641451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 251/495] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:58.641451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.661448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.662434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.662932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.663431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.664467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:58.664980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:58.666641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:58.705201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 245/496] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:58.706695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.755301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b634dd43-c958-4953-aa3a-976263ac5406 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.791543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcf3182-b0af-4ecb-9fea-fbcb8153b1ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.792386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3182-b0af-4ecb-9fea-fbcb8153b1ff None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.792668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3182-b0af-4ecb-9fea-fbcb8153b1ff None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.793004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcf3182-b0af-4ecb-9fea-fbcb8153b1ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.804112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf3182-b0af-4ecb-9fea-fbcb8153b1ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:58.805607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcf3182-b0af-4ecb-9fea-fbcb8153b1ff None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:58.815453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87de5d3a-18a4-499e-9652-a80c3c8f71c9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9bcf3182-b0af-4ecb-9fea-fbcb8153b1ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:58.823735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:58.824616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:58.825496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:58.825496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:58.825496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:58.825496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:58.829588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 252/497] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:58.830797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b5629-0f03-4aa0-949c-eefa90b339b5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.831089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b5629-0f03-4aa0-949c-eefa90b339b5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.831355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b5629-0f03-4aa0-949c-eefa90b339b5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.832430 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:58.836818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 253/498] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:58.836818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b5629-0f03-4aa0-949c-eefa90b339b5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.858915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.859707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.859989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.860265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.867302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:58.870353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:58.871825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:58.890438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:58.891341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:58.892188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:58.892188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:58.892188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:58.892188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:58.892188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 246/499] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:58.892445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:58.941088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b5629-0f03-4aa0-949c-eefa90b339b5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:58.975684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a7e4-1978-447a-abbf-93191e16d43a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:58.976320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a7e4-1978-447a-abbf-93191e16d43a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:58.976598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a7e4-1978-447a-abbf-93191e16d43a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:58.976873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd5a7e4-1978-447a-abbf-93191e16d43a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:58.991253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce17fadd-e416-4322-b204-f02871a57792 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.023180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4a3c63e-8a47-425d-b2e1-a90592e0c99a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.023821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c63e-8a47-425d-b2e1-a90592e0c99a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.024101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c63e-8a47-425d-b2e1-a90592e0c99a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.024367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4a3c63e-8a47-425d-b2e1-a90592e0c99a None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.025075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3c63e-8a47-425d-b2e1-a90592e0c99a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:59.025633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3c63e-8a47-425d-b2e1-a90592e0c99a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.027010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4a3c63e-8a47-425d-b2e1-a90592e0c99a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.038667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 247/500] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:59.039920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f705a5-3b6e-43fc-a44f-8ea4f28c706e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.040204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f705a5-3b6e-43fc-a44f-8ea4f28c706e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.040475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f705a5-3b6e-43fc-a44f-8ea4f28c706e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.045161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a7e4-1978-447a-abbf-93191e16d43a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.046733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fd5a7e4-1978-447a-abbf-93191e16d43a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.057803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-07f705a5-3b6e-43fc-a44f-8ea4f28c706e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:59.059109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-07f705a5-3b6e-43fc-a44f-8ea4f28c706e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:59.076793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.079483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.125856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 248/501] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:59.127221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa915e53-18f4-456f-8856-012894d0c2ad None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.127514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa915e53-18f4-456f-8856-012894d0c2ad None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.127785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa915e53-18f4-456f-8856-012894d0c2ad None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.129577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 249/502] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:23:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:23:59.130123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa915e53-18f4-456f-8856-012894d0c2ad None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.160440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 254/503] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:58 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:23:59.161721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a7e4-1978-447a-abbf-93191e16d43a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.233320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa915e53-18f4-456f-8856-012894d0c2ad None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.259911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd5a7e4-1978-447a-abbf-93191e16d43a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.266625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-660aaa66-950b-447f-9dc4-f2decbf5e734 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.267281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aaa66-950b-447f-9dc4-f2decbf5e734 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.267558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aaa66-950b-447f-9dc4-f2decbf5e734 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.267833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-660aaa66-950b-447f-9dc4-f2decbf5e734 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.268542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aaa66-950b-447f-9dc4-f2decbf5e734 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:59.268846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aaa66-950b-447f-9dc4-f2decbf5e734 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.270244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-660aaa66-950b-447f-9dc4-f2decbf5e734 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.282544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 250/504] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:59.283748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09021586-bc76-43ae-bae1-12e0aaf2a0b7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.284037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09021586-bc76-43ae-bae1-12e0aaf2a0b7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.284358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09021586-bc76-43ae-bae1-12e0aaf2a0b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.296501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.302483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.303276 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.303557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.303831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.304618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-09021586-bc76-43ae-bae1-12e0aaf2a0b7 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:23:59.305866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-09021586-bc76-43ae-bae1-12e0aaf2a0b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:23:59.311270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.312698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.316728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:23:59.327951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:59.329163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 255/505] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/users/cinder => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:59.330131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.381771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 251/506] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:23:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:23:59.382680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09021586-bc76-43ae-bae1-12e0aaf2a0b7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.443411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d130e-f7b2-44c7-8579-33b3d5227d7c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.476327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.477101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.477377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.477680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.487720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.488826 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09021586-bc76-43ae-bae1-12e0aaf2a0b7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.489154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:59.507451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:59.508518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:59.509369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:59.509369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:59.509369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:59.509369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:59.509369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 256/507] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:59.509685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.527450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.528230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.528508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.528777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.539527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.540961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.547591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.554705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:23:59.559272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:59.560158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:59.561618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:23:59.561618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:23:59.561618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:23:59.561618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:23:59.561618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 252/508] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:59.561874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.613103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec82482-0c50-4c69-af8e-cd484e23634e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.647679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.648462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.648740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.649187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.659579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.661043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.662993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d677edcb-0a2e-4297-a566-5153c3723d00 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:23:59.675545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:59.676447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:59.677343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 257/509] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/users/glance => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:59.677966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.703902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.704562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.704835 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.705111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.706022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:59.706329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.707783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.724972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 253/510] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:59.726107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.781472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.783727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfa14a09-ba88-43ba-a678-287fb0887460 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.786155 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.817530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef54dd-ef90-4857-94c1-fca308e96092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.818315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef54dd-ef90-4857-94c1-fca308e96092 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.818596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef54dd-ef90-4857-94c1-fca308e96092 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.818867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deef54dd-ef90-4857-94c1-fca308e96092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.825232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33ba8573-5c8c-4f0d-bd31-e0ca59230017 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.829358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deef54dd-ef90-4857-94c1-fca308e96092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-deef54dd-ef90-4857-94c1-fca308e96092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:23:59.837092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:23:59.837989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 258/511] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:23:59.843918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef54dd-ef90-4857-94c1-fca308e96092 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.859505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.860248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.860593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.860928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.861677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:59.861985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.863429 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.874584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 254/512] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:59.875375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:23:59.942716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deef54dd-ef90-4857-94c1-fca308e96092 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.976287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:23:59.977065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:23:59.977216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:23:59.977530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:23:59.978251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:23:59.978556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:23:59.978643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd1f5cd5-4d95-44da-88c4-b9da0a449fb2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:23:59.979942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:23:59.995605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:23:59.996596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 259/513] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:23:59.997527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.019031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.019692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.019969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.020238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.021059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:00.021362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.022817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.024359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.040635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 255/514] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:00.041451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.101032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e0cf65-16ce-4850-8d56-b80eeb80c13f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.134440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ceae9-1afa-42bc-910c-b437542e3b21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.135000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ceae9-1afa-42bc-910c-b437542e3b21 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.135273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ceae9-1afa-42bc-910c-b437542e3b21 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.135548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-440ceae9-1afa-42bc-910c-b437542e3b21 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.141643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4a69dd2-aad4-4bf3-8f49-43ccdf22f6f3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.174779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.175427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.175703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.175979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.176715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:00.177013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.178399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.186778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 256/515] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:00.187524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.208098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ceae9-1afa-42bc-910c-b437542e3b21 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.210002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-440ceae9-1afa-42bc-910c-b437542e3b21 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.221998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.234199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.286524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c96f221-d8d1-42c3-abb7-c07893afee3c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.308112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 260/516] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:23:59 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:00.308949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ceae9-1afa-42bc-910c-b437542e3b21 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.324194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7c866-5e9a-4da0-adf9-22ea39fc80ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.324861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c866-5e9a-4da0-adf9-22ea39fc80ba None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.325140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c866-5e9a-4da0-adf9-22ea39fc80ba None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.325432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f7c866-5e9a-4da0-adf9-22ea39fc80ba None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.326775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7c866-5e9a-4da0-adf9-22ea39fc80ba None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.328233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41f7c866-5e9a-4da0-adf9-22ea39fc80ba None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.347700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 257/517] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:24:00 2022] POST /identity/v3/users => generated 247 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:00.348339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7c866-5e9a-4da0-adf9-22ea39fc80ba None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.430221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-440ceae9-1afa-42bc-910c-b437542e3b21 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.460772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.463846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.473873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.474683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.474964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.475234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.476303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f7c866-5e9a-4da0-adf9-22ea39fc80ba None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.483694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.485197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:00.501130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:00.502093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:00.502960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 261/518] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:00 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:00.503431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.515346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03aba-e9f3-4555-904c-4007f3f0088e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.516004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03aba-e9f3-4555-904c-4007f3f0088e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.516285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03aba-e9f3-4555-904c-4007f3f0088e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.516554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f03aba-e9f3-4555-904c-4007f3f0088e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.597174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f03aba-e9f3-4555-904c-4007f3f0088e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.598751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f03aba-e9f3-4555-904c-4007f3f0088e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.618530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a890e5-9131-46ac-ae56-296327916f79 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.655047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.655829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.656108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.656380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.667047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.668428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:00.690108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:00.691045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:00.691871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:00.691871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:00.691871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:00.691871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:00.691871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 262/519] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:00.692145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.693525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.705572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 258/520] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 357 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:00.706236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03aba-e9f3-4555-904c-4007f3f0088e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.737108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.805719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebe0ff6-6f35-4c4f-913d-c842b306fd1d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.811227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f03aba-e9f3-4555-904c-4007f3f0088e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.841316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.842415 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.842689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.842970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.848973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:00.851410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:00.851410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:00.851410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:00.851687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:00.852270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.853723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.853840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:00.855309 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:00.872577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 259/521] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:00.873715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:00.874744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:00.875744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:00.876792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:00.876792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:00.876792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:00.876792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:00.878158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 263/522] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:00.878158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:00.942029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.975209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:00.990280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1374d222-6642-4dd4-8321-30bb1e18c758 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:00.993700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b095041-6e77-4823-98a7-82e4ef9f1ead None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.024809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.026024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.026372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.026711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.029681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.030410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.030753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.031144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.031929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:01.032339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.033813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.038562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.040071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.050578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 260/523] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:01.050578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:01.062802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:01.063817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:01.065071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:01.065071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:01.065071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:01.065071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:01.065626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 264/524] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:01.066385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.164195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce372486-8e85-4dcf-89e3-e956d5291907 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.170693 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-295607d5-7646-4044-8142-c7ed34f62788 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.177402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:01.200657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.201668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.202069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.202438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.203381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=1fe88851e1154cf0838e0cbe47459156) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:01.203758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.204246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.204897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.205176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.205470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.205679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.206187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:01.206489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.207836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.217678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 261/525] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/role_assignments?user.id=1fe88851e1154cf0838e0cbe47459156&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:01.217678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.221199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:01.236716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 265/526] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:01.237915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.351580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90409db-44b3-4518-a034-722085dc0b91 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.379021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5130cff-c9de-499d-88e6-93a887917aed None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.393876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.394891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.395303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.395717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.407383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.409119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.428427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.429096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.429376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.429694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.430417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:01.430724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.432087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:01.432670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:01.433534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 08:24:01.434422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:01.437576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 262/527] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/users/neutron => generated 85 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:01.438582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.452118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 266/528] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:01.453101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.481041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:01.531620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:01.562744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bb6d07-a0d0-45ef-837b-76c9742065e6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.579910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-095c89bc-bf2c-47f1-94ec-3d32617fe094 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.612904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.614728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.615181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.615858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.619503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.620285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.620664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.621036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.622006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:01.622413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.624554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.625022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.626885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:01.644088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:01.645150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:01.646217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:01.646217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:01.646217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:01.646217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:01.646217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:01.646217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:01.646217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:01.646217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:01.647994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 263/529] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:01.649897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.668010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 267/530] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:01.669086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.774605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c214e707-3b5c-489d-bbcc-4a12f164cb0d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.782515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:01.790739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e135e9-5237-4be2-a48e-822a6f9b5461 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:01.795522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:01.818936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.820084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.820507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.820920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.822490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:01.823084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.825030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.833280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:01.834216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:01.834595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:01.834970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:01.843132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:01.844891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:01.852997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 268/531] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:01.854180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:01.861988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:01.863012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:01.864074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:01.864074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:01.864074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:01.864074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:01.864074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:01.864074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:01.864074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:01.864074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:01.865609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 264/532] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:01.871207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:01.984910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df35876-2597-4dee-a4aa-a124d86975ed None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:02.006335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18713423-dce2-4d7c-8fb2-acaccee6273d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:02.026936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:02.027513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.027948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.028230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.029815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=91d8f3d11ef745d988fa2749f2a885ee) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:02.030124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:02.031967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:02.039564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 265/533] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/role_assignments?user.id=91d8f3d11ef745d988fa2749f2a885ee&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 259 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:02.040709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:02.049026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6e762-121f-4b19-953b-30760aa82ffb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:02.049800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e762-121f-4b19-953b-30760aa82ffb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.050165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e762-121f-4b19-953b-30760aa82ffb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.050503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de6e762-121f-4b19-953b-30760aa82ffb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.071704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:02.107529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:02.132898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6e762-121f-4b19-953b-30760aa82ffb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:02.133868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de6e762-121f-4b19-953b-30760aa82ffb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:02.168274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d5df1-adb1-4c17-ae95-d3da902dccc8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:02.206623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:02.207636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.208162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.208638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.209836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:02.210343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:02.212007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:02.227134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 266/534] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:02.236005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:02.250857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 269/535] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:01 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:02.262573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6e762-121f-4b19-953b-30760aa82ffb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:02.342204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:02.366401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f6fa3ae-306f-4a5f-93e5-60e8ec6b401f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:02.382996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:02.408647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:02.413439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.413439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.413439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.413439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=993e107cc04e4ce6b9abd9997c29381f) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:02.413439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:02.413439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:02.421073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 267/536] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:02 2022] GET /identity/v3/role_assignments?user.id=993e107cc04e4ce6b9abd9997c29381f&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:02.424973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de6e762-121f-4b19-953b-30760aa82ffb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:02.493174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-956cdd91-663b-43b5-8523-c6ee74bc545c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:02.494005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cdd91-663b-43b5-8523-c6ee74bc545c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.494282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cdd91-663b-43b5-8523-c6ee74bc545c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.494553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-956cdd91-663b-43b5-8523-c6ee74bc545c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.511773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cdd91-663b-43b5-8523-c6ee74bc545c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:02.514199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-956cdd91-663b-43b5-8523-c6ee74bc545c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-956cdd91-663b-43b5-8523-c6ee74bc545c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:02.538484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:02.539388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:02.540638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:02.540638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:02.540638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:02.540638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:02.540638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 270/537] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:02.550607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:02.699292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c4ffb5-5942-4036-b5ec-732f1c1adfc7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:02.708355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311272-dfcc-4d64-8560-f981fe912eb6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.708637 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311272-dfcc-4d64-8560-f981fe912eb6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.708909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d311272-dfcc-4d64-8560-f981fe912eb6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.710690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 271/538] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:02.715863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85ee05-fbf4-4494-a3fe-bbedc7a71ed7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.716147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85ee05-fbf4-4494-a3fe-bbedc7a71ed7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.716423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a85ee05-fbf4-4494-a3fe-bbedc7a71ed7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.736138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5a85ee05-fbf4-4494-a3fe-bbedc7a71ed7 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:02.737641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5a85ee05-fbf4-4494-a3fe-bbedc7a71ed7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:02.742820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:02.743486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.743769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.744043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.744766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:02.745071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:02.753452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:02.759531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 268/539] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:02.765592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:02.769161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:02.870488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b4e4e1-8804-4d3e-85ed-76f6160afac0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:02.907170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:02.907999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:02.908226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:02.908424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 272/540] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:24:02.908523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:02.923767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:02.925225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:02.943626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:02.944527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:02.945364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:02.945364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:02.945364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:02.945364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:02.945364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:02.945364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:02.945364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:02.945364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:02.949801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 269/541] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:02.950724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85ee05-fbf4-4494-a3fe-bbedc7a71ed7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:02.962160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:03.028383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:03.062999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:03.112592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a85ee05-fbf4-4494-a3fe-bbedc7a71ed7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:03.121268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078a9d93-6e56-4072-9ce7-4ed5beb084fb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:03.165776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:03.166496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:03.166774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:03.167054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:03.167885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:03.168197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:03.169665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:03.188464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 273/542] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:03.191824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c78f0-f2cf-4a86-8d48-60f50f5d8493 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:03.192626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c78f0-f2cf-4a86-8d48-60f50f5d8493 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:03.192906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c78f0-f2cf-4a86-8d48-60f50f5d8493 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:03.193181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-813c78f0-f2cf-4a86-8d48-60f50f5d8493 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:03.194556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:03.219502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-813c78f0-f2cf-4a86-8d48-60f50f5d8493 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-813c78f0-f2cf-4a86-8d48-60f50f5d8493 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:03.238933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:03.239880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:03.240676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:03.243763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 270/543] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:02 2022] GET /identity/v3/roles/service => generated 85 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:03.248950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c78f0-f2cf-4a86-8d48-60f50f5d8493 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:03.380220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4147b8-fa85-4e26-9843-c3f77287a37d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:03.426863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:03.448567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d806476-5bcd-4e98-b16d-9dff9605e2d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:03.449316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806476-5bcd-4e98-b16d-9dff9605e2d4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:03.449720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806476-5bcd-4e98-b16d-9dff9605e2d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:03.450456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d806476-5bcd-4e98-b16d-9dff9605e2d4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:03.451633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d806476-5bcd-4e98-b16d-9dff9605e2d4 None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=686a32aea0b945d9a76875110c8f84ca) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:03.452137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d806476-5bcd-4e98-b16d-9dff9605e2d4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:03.453785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d806476-5bcd-4e98-b16d-9dff9605e2d4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:03.454325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-813c78f0-f2cf-4a86-8d48-60f50f5d8493 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:03.460405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 274/544] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:03 2022] GET /identity/v3/role_assignments?user.id=686a32aea0b945d9a76875110c8f84ca&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 259 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:03.509626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:03.526583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4693-2c4d-42b4-8914-27a644d79d44 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:03.526849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4693-2c4d-42b4-8914-27a644d79d44 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:03.527113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8e4693-2c4d-42b4-8914-27a644d79d44 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:03.528802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 275/545] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:03.531874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:03.532958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:03.533243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:03.533558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:03.534321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:03.534625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:03.535461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ace1b6-9413-464a-9b65-83ea64d3b794 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:03.535941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ace1b6-9413-464a-9b65-83ea64d3b794 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:03.536042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:03.536512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47ace1b6-9413-464a-9b65-83ea64d3b794 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:03.550881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 271/546] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:03.552234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:03.554531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-47ace1b6-9413-464a-9b65-83ea64d3b794 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:03.556022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-47ace1b6-9413-464a-9b65-83ea64d3b794 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:03.692229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 276/547] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:03 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:03.717316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873c6447-5d06-473e-9faa-13b5bde57b3f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:03.725658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ace1b6-9413-464a-9b65-83ea64d3b794 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:03.803466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:03.804263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:03.804543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:03.804815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:03.834308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:03.835689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47ace1b6-9413-464a-9b65-83ea64d3b794 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:03.835802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:03.853787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:03.873312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:03.874230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:03.875068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:03.875068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:03.875068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:03.875068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:03.879654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 272/548] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:03.882232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0974e-0016-4126-8d98-e0bf8a3ed4c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:03.882457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:03.883148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0974e-0016-4126-8d98-e0bf8a3ed4c9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:03.883430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0974e-0016-4126-8d98-e0bf8a3ed4c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:03.883704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a0974e-0016-4126-8d98-e0bf8a3ed4c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:03.895550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a0974e-0016-4126-8d98-e0bf8a3ed4c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f6a0974e-0016-4126-8d98-e0bf8a3ed4c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:03.903920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:03.906911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:03.909411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 277/549] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:03 2022] GET /identity/v3/roles/service => generated 85 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:03.913454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0974e-0016-4126-8d98-e0bf8a3ed4c9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:03.963773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:04.078002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de35a132-cb11-4fb0-acb4-8c1d567ebf49 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:04.103890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a0974e-0016-4126-8d98-e0bf8a3ed4c9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:04.146959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24845cea-b113-444c-a12d-282acd907506 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:04.147621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24845cea-b113-444c-a12d-282acd907506 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.147900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24845cea-b113-444c-a12d-282acd907506 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.148168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24845cea-b113-444c-a12d-282acd907506 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.148879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24845cea-b113-444c-a12d-282acd907506 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:04.149175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24845cea-b113-444c-a12d-282acd907506 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:04.150824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24845cea-b113-444c-a12d-282acd907506 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:04.170595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:04.171310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.171593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.171867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.172610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:04.172911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:04.174296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:04.181590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 273/550] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:04.184164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24845cea-b113-444c-a12d-282acd907506 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:04.190621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 278/551] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:03 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:04.195868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:04.235851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:04.310652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:04.316477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24845cea-b113-444c-a12d-282acd907506 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:04.352945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3805092-5342-4129-ba80-fd09fda83f67 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:04.353626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:04.354639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.355144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.355629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.364375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:04.366554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:04.397530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:04.398574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:04.399565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 274/552] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:04 2022] GET /identity/v3/users/swift => generated 83 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:04.402436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:04.414994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:04.415613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.415896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.416168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.445425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:04.446895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:04.472217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:04.474342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:04.475607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:04.475607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:04.475607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:04.475607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:04.475607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 279/553] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:04.481713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:04.564222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f743707-c245-45f4-b4ab-4cf66a8a4d70 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:04.591460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:04.604546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbcfb4c-632e-4006-ad17-f8d1894688cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:04.605483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534af399-eafa-4da4-bb00-5088f128aa58 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:04.605743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfb4c-632e-4006-ad17-f8d1894688cf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.606245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfb4c-632e-4006-ad17-f8d1894688cf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.606714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbcfb4c-632e-4006-ad17-f8d1894688cf None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.608421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcfb4c-632e-4006-ad17-f8d1894688cf None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:04.608941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcfb4c-632e-4006-ad17-f8d1894688cf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:04.610708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cbcfb4c-632e-4006-ad17-f8d1894688cf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:04.630434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 275/554] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 12 08:24:04 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:04.632062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3279d-491f-4f6b-bc12-4751e30490c8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.632548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3279d-491f-4f6b-bc12-4751e30490c8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.633082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3279d-491f-4f6b-bc12-4751e30490c8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.634793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 276/555] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:04.637865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3279d-491f-4f6b-bc12-4751e30490c8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:04.655835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc53aede-e7d3-4fb5-8321-f89d50f7557b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:04.656605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53aede-e7d3-4fb5-8321-f89d50f7557b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.656889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53aede-e7d3-4fb5-8321-f89d50f7557b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.657156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc53aede-e7d3-4fb5-8321-f89d50f7557b None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.658339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53aede-e7d3-4fb5-8321-f89d50f7557b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:04.658339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53aede-e7d3-4fb5-8321-f89d50f7557b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:04.659758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc53aede-e7d3-4fb5-8321-f89d50f7557b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:04.661220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:04.674602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 280/556] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:04.679336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42d01a-e327-499a-b41e-58fae3e0ad7f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.679336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42d01a-e327-499a-b41e-58fae3e0ad7f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.679336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff42d01a-e327-499a-b41e-58fae3e0ad7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.695888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ff42d01a-e327-499a-b41e-58fae3e0ad7f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:04.697204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ff42d01a-e327-499a-b41e-58fae3e0ad7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:04.759436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3279d-491f-4f6b-bc12-4751e30490c8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:04.776750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 281/557] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:04.777617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42d01a-e327-499a-b41e-58fae3e0ad7f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:04.798339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac5c6e-72bb-4d58-9cf3-865bcef7cc24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:04.799305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5c6e-72bb-4d58-9cf3-865bcef7cc24 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.799813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5c6e-72bb-4d58-9cf3-865bcef7cc24 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.800361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ac5c6e-72bb-4d58-9cf3-865bcef7cc24 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.862086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:04.876636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac5c6e-72bb-4d58-9cf3-865bcef7cc24 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:04.878563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ac5c6e-72bb-4d58-9cf3-865bcef7cc24 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:04.886072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff42d01a-e327-499a-b41e-58fae3e0ad7f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:04.897057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:04.925345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:04.926169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:04.926447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:04.926782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:04.934509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:04.936484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:04.951873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:04.953286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:04.954252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:04.957718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 282/558] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:24:04 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:04.959378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:04.992755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 277/559] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:04 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:04.993932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac5c6e-72bb-4d58-9cf3-865bcef7cc24 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.068643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9aa75c-220f-4901-a1dc-d081544340df None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.102066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92925239-651e-4a79-a8cd-4559f2393e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.102861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925239-651e-4a79-a8cd-4559f2393e18 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.103130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925239-651e-4a79-a8cd-4559f2393e18 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.103399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92925239-651e-4a79-a8cd-4559f2393e18 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.105539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ac5c6e-72bb-4d58-9cf3-865bcef7cc24 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.110711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:05.115466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92925239-651e-4a79-a8cd-4559f2393e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-92925239-651e-4a79-a8cd-4559f2393e18 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:05.123098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:05.124246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:05.125111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 283/560] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:05.125866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b315d-4c6c-496b-8351-777f0892fc4b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.125866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b315d-4c6c-496b-8351-777f0892fc4b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.126517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-192b315d-4c6c-496b-8351-777f0892fc4b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.131284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 284/561] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:05.131284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b315d-4c6c-496b-8351-777f0892fc4b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.133566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:05.154299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.155296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.155725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.156194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.157170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:05.157676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:05.159478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:05.179617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 278/562] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:24:04 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:05.180465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.245115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-192b315d-4c6c-496b-8351-777f0892fc4b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.284755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc6d8a5-7302-4622-9619-65549c512474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.285572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d8a5-7302-4622-9619-65549c512474 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.285849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d8a5-7302-4622-9619-65549c512474 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.286202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc6d8a5-7302-4622-9619-65549c512474 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.294464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66182cec-867e-4428-989f-3f442cbcf8c8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.297264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d8a5-7302-4622-9619-65549c512474 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:05.299516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc6d8a5-7302-4622-9619-65549c512474 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-acc6d8a5-7302-4622-9619-65549c512474 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:05.319721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:05.320684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:05.321988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:05.321988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:05.321988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:05.321988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:05.321988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 285/563] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:05.322677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ec8e9-a623-475e-8a46-3a42d025a641 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.322845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ec8e9-a623-475e-8a46-3a42d025a641 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.323080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff6ec8e9-a623-475e-8a46-3a42d025a641 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.337482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.338163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.338446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.338721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.339468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:05.339776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:05.341143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:05.341310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ff6ec8e9-a623-475e-8a46-3a42d025a641 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:05.342770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ff6ec8e9-a623-475e-8a46-3a42d025a641 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:05.350605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 279/564] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:05.351433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.390444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:05.397644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:05.428393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 286/565] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:05.429354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ec8e9-a623-475e-8a46-3a42d025a641 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.475282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e68d050e-3b23-4418-b17f-d0902897be7e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.512341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.513239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.514145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.514507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.525980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:05.527664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:05.536460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff6ec8e9-a623-475e-8a46-3a42d025a641 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:05.547955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:05.548850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:05.549756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:05.549756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:05.549756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:05.549756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:05.549756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 280/566] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:05.550556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.577789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.578453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.578734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.579186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.579916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:05.580228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:05.581621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:05.597814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 287/567] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:05.597814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.640698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:05.652963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:05.667357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de4a881-5b6f-4ee2-a116-9b78d831c1e7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.702022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.702836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.703083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.703351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.703533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40c27eb-234a-474b-9870-03e314f9f538 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.714809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:05.716261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:05.738227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:05.739122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:05.740002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:05.740002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:05.740002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:05.740002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:05.740218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0e7f-0c95-4792-8d12-d73aca327a8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.740322 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 281/568] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:05.740394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0e7f-0c95-4792-8d12-d73aca327a8e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.740463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.740530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0e7f-0c95-4792-8d12-d73aca327a8e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.740598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15f0e7f-0c95-4792-8d12-d73aca327a8e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.754140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b15f0e7f-0c95-4792-8d12-d73aca327a8e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b15f0e7f-0c95-4792-8d12-d73aca327a8e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:05.761797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:05.762683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:05.763530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 288/569] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:05.764256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0e7f-0c95-4792-8d12-d73aca327a8e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.844322 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deee7d99-991a-44c7-85fc-384903846acb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.859660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:05.863144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15f0e7f-0c95-4792-8d12-d73aca327a8e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:05.877653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a43512e-2e30-44c6-a7ad-7727b594caaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.878303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43512e-2e30-44c6-a7ad-7727b594caaa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.878578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43512e-2e30-44c6-a7ad-7727b594caaa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.878848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a43512e-2e30-44c6-a7ad-7727b594caaa None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.879554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43512e-2e30-44c6-a7ad-7727b594caaa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:05.879853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43512e-2e30-44c6-a7ad-7727b594caaa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:05.881224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a43512e-2e30-44c6-a7ad-7727b594caaa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:05.890168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:05.893919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 282/570] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:05.895101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8162ad-2a53-450f-8570-eb405bea9fdf None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.895385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8162ad-2a53-450f-8570-eb405bea9fdf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.895659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e8162ad-2a53-450f-8570-eb405bea9fdf None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.896989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 283/571] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:05.897573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8162ad-2a53-450f-8570-eb405bea9fdf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:05.898413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:05.899454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:05.899737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:05.900010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:05.908482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:05.910035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:05.924222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:05.925362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 289/572] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:05.926503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.000240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e8162ad-2a53-450f-8570-eb405bea9fdf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.024926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afef7f6-df2d-42e2-9a5f-4515f98fbb7d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.034188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.034836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.035119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.035395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.036112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:06.036419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.037794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.049845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 284/573] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:06.050668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.062916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e38842-2a42-47a6-bacb-ecb3df690154 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.063567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38842-2a42-47a6-bacb-ecb3df690154 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.063842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38842-2a42-47a6-bacb-ecb3df690154 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.064111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e38842-2a42-47a6-bacb-ecb3df690154 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.064845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e38842-2a42-47a6-bacb-ecb3df690154 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:06.065145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e38842-2a42-47a6-bacb-ecb3df690154 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.066541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e38842-2a42-47a6-bacb-ecb3df690154 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.074273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 290/574] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:06.075411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ed42-71b7-4ed5-94e2-7c74dd9c8204 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.075691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ed42-71b7-4ed5-94e2-7c74dd9c8204 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.076576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e13ed42-71b7-4ed5-94e2-7c74dd9c8204 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.093934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6e13ed42-71b7-4ed5-94e2-7c74dd9c8204 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:06.095111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e13ed42-71b7-4ed5-94e2-7c74dd9c8204 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:06.110279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:06.113661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:06.153674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c84b6f2-c957-450d-950d-78cbec9a8609 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.164858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 291/575] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:06.165713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13ed42-71b7-4ed5-94e2-7c74dd9c8204 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.199593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.200382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.200661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.201676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.208335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.209798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:06.223640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:06.224524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:06.225401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 285/576] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:06.225929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.267680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e13ed42-71b7-4ed5-94e2-7c74dd9c8204 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.300929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.301604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.301880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.302239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.302921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:06.303220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.304651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.316738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 292/577] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:06.317549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.327794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63759b1-ed50-4fc5-9857-3de07b75e941 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.332926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:06.348026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:06.362220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.363326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.363600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.370504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.371932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:06.386615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:06.387557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:06.389137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 286/578] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:06.389874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.424141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c0036e-b5bb-4239-a65f-e69951141f5c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.457137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.457951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.458229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.458498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.469361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.470821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:06.487548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:06.488473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:06.489382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:06.489382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:06.489382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:06.489382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:06.489382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 293/579] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:06.490067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.490167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f449d16d-7185-44b3-8b4e-7bee7494400f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.526920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8243c13-f13c-4316-be4c-19f0002670b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.527700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8243c13-f13c-4316-be4c-19f0002670b1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.527981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8243c13-f13c-4316-be4c-19f0002670b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.528254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8243c13-f13c-4316-be4c-19f0002670b1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.538214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8243c13-f13c-4316-be4c-19f0002670b1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b8243c13-f13c-4316-be4c-19f0002670b1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:06.546657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:06.547854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 287/580] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/roles/service => generated 85 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:06.548733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8243c13-f13c-4316-be4c-19f0002670b1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.556933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:06.589784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:06.595926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816a2689-4cab-4e83-8389-20cd68c05b63 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.636040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.636702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.636971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.637244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.638054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:06.638440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.640095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.648930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8243c13-f13c-4316-be4c-19f0002670b1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.652642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 294/581] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:06.653263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.684140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.684710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.684989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.685919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.686906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=5de7841acf434c53a3c17ee73fae76e0) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:06.687222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.688641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.693959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 288/582] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/role_assignments?user.id=5de7841acf434c53a3c17ee73fae76e0&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 259 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:06.694724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.777081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ee1ab2-3c0f-46a0-8de2-2b3b4642c717 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.801687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-134b3d5b-d669-4284-a330-308b3bbc2db2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.804103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:06.808358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:06.823390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.824076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.824359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.824633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.825523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:06.825864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.827984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.839881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:06.840546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:06.840827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:06.841099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:06.842151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:06.842466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:06.844569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:06.849881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 295/583] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:06.854398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.861540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 289/584] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:06.862456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:06.963763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241c949-6e12-4639-ac16-d292f85852b8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:06.979889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10579b3e-42e6-431a-b868-eb81247fc6fa None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.000155 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.000825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.001109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.001636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.002175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:07.002485 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.003853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.017055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 296/585] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:07.017055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.025709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f0006-4d60-4439-8962-467085f9d6c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.026712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f0006-4d60-4439-8962-467085f9d6c0 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.026994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f0006-4d60-4439-8962-467085f9d6c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.027270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995f0006-4d60-4439-8962-467085f9d6c0 None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/1fe88851e1154cf0838e0cbe47459156/roles/48eb4b7efc744ce28a9b3dd160821614` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.043770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f0006-4d60-4439-8962-467085f9d6c0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=1fe88851e1154cf0838e0cbe47459156, role_id=48eb4b7efc744ce28a9b3dd160821614)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.045588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995f0006-4d60-4439-8962-467085f9d6c0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.058654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 290/586] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:06 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/1fe88851e1154cf0838e0cbe47459156/roles/48eb4b7efc744ce28a9b3dd160821614 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:24:07.059514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f0006-4d60-4439-8962-467085f9d6c0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.074380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:07.081401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:07.165308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2e640d-46f8-4d91-8f6c-31b3318d1a7e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.188486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995f0006-4d60-4439-8962-467085f9d6c0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.211121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.211930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.212211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.212488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.229014 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.229587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.230431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.230865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.231338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.231817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.241343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.243079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:07.251522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:07.252640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:07.253854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:07.253854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:07.253854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:07.253854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:07.253854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 297/587] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:07.253854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:07.262289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:07.263886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 08:24:07.264877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:07.267142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 291/588] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/users/glance => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:07.268182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.367609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:07.369397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:07.376868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9de476-031b-4529-a169-a371cda52215 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.395800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5412884f-4a8c-4eab-bd3d-5087de0ba3e3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.415958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.416978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.417399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.417867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.430960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.433100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.438764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.439581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.439969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.440346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.441175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:07.441651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.443135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:07.453585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:07.454729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:07.455617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:07.455617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:07.455617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:07.455617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:07.462144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 292/590] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:07.462348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 298/590] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:07.463080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.463612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.569767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52a45573-29b0-4f6d-bddf-0cd20627beb1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.572867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfac3b-44d1-4982-a269-0adffa46a7d0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.606336 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.607799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.608620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.609110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.610260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:07.610675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.612518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.613016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.614139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.614535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:07.615033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.616135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.624584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.626367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.632673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 293/591] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:07.633715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:07.642775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:07.643673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:07.644551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:07.644551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:07.644551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:07.644551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:07.644551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:07.644551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:07.644551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:07.644551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:07.647393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 299/592] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:07.648399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.717795 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:07.745722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c2fecc3-18d4-473e-af5d-499d1daa3166 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.762539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-117b6501-0e2d-41a6-93f0-87dcf4a80977 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.783812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.784582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.784936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.785288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.786103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:07.786793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.787985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.805269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 294/593] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:07.805269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.807453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.808472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.808960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.809450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.822265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.824080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:07.844191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:07.845159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:07.846067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:07.846067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:07.846067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:07.846067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:07.848065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 300/594] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:07.849241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:07.870211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:07.913735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fadc259-ac73-4c19-85fc-1b28c7d97ae0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.915312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:07.949642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:07.950391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:07.950674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:07.951603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:07.952399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:07.952712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:07.954162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:07.970236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800b65dc-bcf9-43c3-bb96-ab8697164161 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:07.971943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 295/595] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:07.972790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:08.013947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:08.015130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:08.015969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:08.016451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:08.026381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:08.028750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:08.064498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:08.066333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 301/596] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:08.075975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:08.098217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef75bba5-ebbb-4fc0-bc94-95e17a27569c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:08.114088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:08.138760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:08.139763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:08.140241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:08.140825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:08.141901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:08.142413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:08.144147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:08.157223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 296/597] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:08.158468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:08.187300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cf93c5f-bbe5-411e-8cee-9e07edbffd4b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:08.208319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:08.223820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125b877-8744-42cc-b8c7-9a84310966e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:08.224708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b877-8744-42cc-b8c7-9a84310966e8 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:08.224985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b877-8744-42cc-b8c7-9a84310966e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:08.225258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e125b877-8744-42cc-b8c7-9a84310966e8 None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/91d8f3d11ef745d988fa2749f2a885ee/roles/48eb4b7efc744ce28a9b3dd160821614` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:08.241714 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125b877-8744-42cc-b8c7-9a84310966e8 None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=91d8f3d11ef745d988fa2749f2a885ee, role_id=48eb4b7efc744ce28a9b3dd160821614)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:08.243166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e125b877-8744-42cc-b8c7-9a84310966e8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:08.258657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 302/598] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:08 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/91d8f3d11ef745d988fa2749f2a885ee/roles/48eb4b7efc744ce28a9b3dd160821614 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:24:08.259511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125b877-8744-42cc-b8c7-9a84310966e8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:08.290053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e412f4-c4d2-414f-897f-5fba16a05806 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:08.368577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:08.369635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:08.370152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:08.370760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:08.371811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:08.372350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:08.375291 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:08.390680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e125b877-8744-42cc-b8c7-9a84310966e8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:08.413394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 297/599] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 12 08:24:08 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:08.424020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:08.432829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:08.433733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:08.434020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:08.434296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:08.442511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:08.443977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:08.459023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:08.459958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:08.460895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 303/600] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:08.467271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:08.477013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:08.502647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:08.572604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00651e71-5ab2-4b08-83ce-17c21a545eec None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:08.616516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c577ac-c7a2-48d0-8500-bc81e419a5af None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:08.637159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:08.637945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:08.638487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:08.638777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:08.662189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:08.664859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:08.670051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:08.670899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:08.671324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:08.671793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:08.672893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:08.673358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:08.675015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:08.688767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 304/601] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:08.696959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:08.697958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:08.698856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:08.698856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:08.698856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:08.698856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:08.699097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:08.701432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 298/602] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:08.709471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:08.857898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:08.863811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaba7f96-8555-4d13-ba72-4501ce53d18d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:08.892288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:08.899143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:08.899802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:08.900086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:08.900358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:08.901344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:08.901673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:08.903048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:08.919254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 299/603] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:08.919440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da7f3c85-c63c-4c3f-a1ef-13dad4b5ccb6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:08.921096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:09.002609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df544da-4619-4227-aab6-a77f270ed7e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:09.003554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df544da-4619-4227-aab6-a77f270ed7e0 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.003836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df544da-4619-4227-aab6-a77f270ed7e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.004107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df544da-4619-4227-aab6-a77f270ed7e0 None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/993e107cc04e4ce6b9abd9997c29381f/roles/48eb4b7efc744ce28a9b3dd160821614` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.021255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df544da-4619-4227-aab6-a77f270ed7e0 None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=993e107cc04e4ce6b9abd9997c29381f, role_id=48eb4b7efc744ce28a9b3dd160821614)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:09.022726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df544da-4619-4227-aab6-a77f270ed7e0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:09.031333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70467256-a420-4e7b-98bd-96d4312d75b9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:09.042442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 305/604] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:08 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/993e107cc04e4ce6b9abd9997c29381f/roles/48eb4b7efc744ce28a9b3dd160821614 => generated 0 bytes in 344 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:24:09.044198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb2234-55cc-45c2-be47-ce2ee2968b86 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.045350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb2234-55cc-45c2-be47-ce2ee2968b86 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.045836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23fb2234-55cc-45c2-be47-ce2ee2968b86 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.052363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 306/605] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:09.054428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de5ef5-db1f-4ab1-b512-f76c86c2b143 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.054899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de5ef5-db1f-4ab1-b512-f76c86c2b143 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.055386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0de5ef5-db1f-4ab1-b512-f76c86c2b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.075016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b0de5ef5-db1f-4ab1-b512-f76c86c2b143 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:09.077298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b0de5ef5-db1f-4ab1-b512-f76c86c2b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:09.086208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:09.087029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.087303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.087568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.102851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:09.104339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:09.132164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:09.133122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:09.134518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:09.134518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:09.134518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:09.134518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:09.134518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:09.134518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:09.134518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:09.134518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:09.134961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 300/606] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:09.142878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:09.153792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:09.171120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 307/607] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:09.194661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de5ef5-db1f-4ab1-b512-f76c86c2b143 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:09.310819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:09.340033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe0440e-26e6-44de-819d-30f922ed2fea None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:09.348641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0de5ef5-db1f-4ab1-b512-f76c86c2b143 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:09.391959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514c935-95ff-473a-b6da-47a9fa3a5af8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:09.393070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c935-95ff-473a-b6da-47a9fa3a5af8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.393530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c935-95ff-473a-b6da-47a9fa3a5af8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.394078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514c935-95ff-473a-b6da-47a9fa3a5af8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.398201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4655a731-fb34-4e43-8f97-734b0e3da906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:09.398873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a731-fb34-4e43-8f97-734b0e3da906 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.399155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a731-fb34-4e43-8f97-734b0e3da906 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.399431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4655a731-fb34-4e43-8f97-734b0e3da906 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.400229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655a731-fb34-4e43-8f97-734b0e3da906 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:09.400805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655a731-fb34-4e43-8f97-734b0e3da906 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:09.402263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4655a731-fb34-4e43-8f97-734b0e3da906 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:09.407298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514c935-95ff-473a-b6da-47a9fa3a5af8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5514c935-95ff-473a-b6da-47a9fa3a5af8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:09.415192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:09.416127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:09.417041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 308/608] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:09.421669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7c5d5-5f96-461c-a5a2-f498042087d8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.423082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7c5d5-5f96-461c-a5a2-f498042087d8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.423753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7c5d5-5f96-461c-a5a2-f498042087d8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.426685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 309/609] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:09 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:09.427522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 301/610] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:09.432342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7c5d5-5f96-461c-a5a2-f498042087d8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:09.436651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282402-9de4-47a2-86e4-ccdda7a69557 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.437046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282402-9de4-47a2-86e4-ccdda7a69557 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.437447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58282402-9de4-47a2-86e4-ccdda7a69557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.454216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-58282402-9de4-47a2-86e4-ccdda7a69557 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:09.455666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-58282402-9de4-47a2-86e4-ccdda7a69557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:09.530213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:09.547537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 302/611] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:09.549050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282402-9de4-47a2-86e4-ccdda7a69557 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:09.563136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7c5d5-5f96-461c-a5a2-f498042087d8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:09.602009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:09.609591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:09.610275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.610537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.610805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.611544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:09.611861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:09.613230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:09.622002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 310/612] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:09.623343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:09.679054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58282402-9de4-47a2-86e4-ccdda7a69557 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:09.718719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a748f7-30a5-4230-9a0b-0b4983d57dd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:09.720078 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a748f7-30a5-4230-9a0b-0b4983d57dd3 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.720566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a748f7-30a5-4230-9a0b-0b4983d57dd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.721061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a748f7-30a5-4230-9a0b-0b4983d57dd3 None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/686a32aea0b945d9a76875110c8f84ca/roles/48eb4b7efc744ce28a9b3dd160821614` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.734837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c44b8f-de99-4eb0-87ac-af8426c543a6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:09.738704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a748f7-30a5-4230-9a0b-0b4983d57dd3 None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=686a32aea0b945d9a76875110c8f84ca, role_id=48eb4b7efc744ce28a9b3dd160821614)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:09.740390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a748f7-30a5-4230-9a0b-0b4983d57dd3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:09.764800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 303/613] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:09 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/686a32aea0b945d9a76875110c8f84ca/roles/48eb4b7efc744ce28a9b3dd160821614 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:24:09.764800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a748f7-30a5-4230-9a0b-0b4983d57dd3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:09.787720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1d8a1-43ac-4e79-a066-89913e50a2b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:09.788539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d8a1-43ac-4e79-a066-89913e50a2b8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:09.788813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d8a1-43ac-4e79-a066-89913e50a2b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:09.789078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e1d8a1-43ac-4e79-a066-89913e50a2b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:09.802683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e1d8a1-43ac-4e79-a066-89913e50a2b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-44e1d8a1-43ac-4e79-a066-89913e50a2b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:09.811876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:09.812904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:09.813773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 311/614] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:09.818935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1d8a1-43ac-4e79-a066-89913e50a2b8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:09.872242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:09.959070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a748f7-30a5-4230-9a0b-0b4983d57dd3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:09.969271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:10.004683 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.005176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.005621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.006004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.019831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:10.021467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:10.042264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:10.043408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:10.045312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:10.045312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:10.045312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:10.045312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:10.045625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e1d8a1-43ac-4e79-a066-89913e50a2b8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:10.049610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 304/615] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:10.052704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:10.124563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.127511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.127511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.127511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.130231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:10.130814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:10.134403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:10.154599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 312/616] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:10.159674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:10.200318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:10.210928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb97d2a0-1c12-4497-9cc7-6928248862c5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:10.273815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.274637 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.275019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.275665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.276498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:10.277041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:10.280077 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:10.302984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 305/617] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:10.308669 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:10.334211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a913983-b3f3-4707-9120-c5aed2b5e61e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:10.365913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:10.408813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.409643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.409917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.410187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.428042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:10.429742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:10.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:10.472681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:10.473599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:10.473599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:10.473599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:10.473599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:10.480477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 313/618] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:10.481337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:10.507825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bfe06a2-c8c0-4c41-9e0e-71347a8aaeda None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:10.556396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efefefee-ba83-4e39-bf2a-23ecff4c3aef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.557212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefefee-ba83-4e39-bf2a-23ecff4c3aef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.557515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefefee-ba83-4e39-bf2a-23ecff4c3aef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.557793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efefefee-ba83-4e39-bf2a-23ecff4c3aef None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.568751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefefee-ba83-4e39-bf2a-23ecff4c3aef None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:10.570550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efefefee-ba83-4e39-bf2a-23ecff4c3aef None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-efefefee-ba83-4e39-bf2a-23ecff4c3aef None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:10.590727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:10.592307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:10.593402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:10.597147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 306/619] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:10.599149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ede73-3a61-465a-9af8-527fefe6b000 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.599443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ede73-3a61-465a-9af8-527fefe6b000 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.599722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-309ede73-3a61-465a-9af8-527fefe6b000 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.601695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 307/620] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:10.602474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ede73-3a61-465a-9af8-527fefe6b000 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:10.635556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:10.644865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33156541-7e3c-41b9-85ae-9bd0eaad0814 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:10.695929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313f7a5b-f95a-440e-afee-3cd5681f6781 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.697810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7a5b-f95a-440e-afee-3cd5681f6781 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.698281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7a5b-f95a-440e-afee-3cd5681f6781 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.698737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313f7a5b-f95a-440e-afee-3cd5681f6781 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.699656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f7a5b-f95a-440e-afee-3cd5681f6781 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:10.700143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f7a5b-f95a-440e-afee-3cd5681f6781 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:10.703303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313f7a5b-f95a-440e-afee-3cd5681f6781 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:10.721697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 314/621] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:10.723317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739376aa-20ef-488b-b0dc-74bd311fa80a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.723809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739376aa-20ef-488b-b0dc-74bd311fa80a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.724265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739376aa-20ef-488b-b0dc-74bd311fa80a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.734475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-309ede73-3a61-465a-9af8-527fefe6b000 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:10.748527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-739376aa-20ef-488b-b0dc-74bd311fa80a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:10.750683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-739376aa-20ef-488b-b0dc-74bd311fa80a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:10.772860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:10.783815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.784928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.785718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.786405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.787421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:10.787901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:10.789532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:10.811446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 308/622] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 12 08:24:10 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:10.812525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:10.830283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 315/623] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:10.837487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739376aa-20ef-488b-b0dc-74bd311fa80a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:10.906849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:10.939136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01be5bf0-7ac7-483e-b6c7-e19da4867eb4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:10.953859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739376aa-20ef-488b-b0dc-74bd311fa80a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:10.980085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.981446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.981847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.982482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:10.990262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:10.991802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:10.992685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:10.993664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:10.994102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:10.994518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.005630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:11.007339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:11.007479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:11.008589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:11.009666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:11.010211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 309/624] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:24:10 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:11.013843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:11.034794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:11.035773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:11.036670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:11.036670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:11.036670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:11.036670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:11.040605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 316/625] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:11.041865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.052783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:11.132429 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be3be0d-52ff-4013-b3d5-bc47b4238251 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:11.152183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3eed61-3431-493e-a2d7-830f2a11ea95 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:11.167916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:11.175832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a37cf-450f-429c-9e99-5f03fac49cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:11.176955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a37cf-450f-429c-9e99-5f03fac49cf8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.177469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a37cf-450f-429c-9e99-5f03fac49cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.177949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07a37cf-450f-429c-9e99-5f03fac49cf8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.190062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07a37cf-450f-429c-9e99-5f03fac49cf8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:11.190361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:11.191031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.191309 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.191582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.192419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:11.192726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:11.194177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a07a37cf-450f-429c-9e99-5f03fac49cf8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:11.199717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:11.201213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:11.202632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:11.210055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 310/626] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:11.211131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a37cf-450f-429c-9e99-5f03fac49cf8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.217316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 317/627] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:11.218346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.293867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:11.333393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-023dda30-39c0-440a-81b5-1229c02a3f41 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:11.345693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07a37cf-450f-429c-9e99-5f03fac49cf8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:11.372312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:11.373849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.374021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.374290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.375002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:11.375307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:11.376674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:11.390613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 318/628] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:11.390613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.397547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:11.398791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.399236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.399663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.400825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:11.401643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:11.403651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:11.424903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 311/629] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:11.424903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.476936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:11.508664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973cc638-4bc4-453d-b833-c1ee6dd91b15 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:11.527398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f78e77-da8d-4138-8955-82a65e8086e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:11.537938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:11.548339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6825e-7bcc-401e-bd4e-b89ad38074d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:11.548989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6825e-7bcc-401e-bd4e-b89ad38074d3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.549196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6825e-7bcc-401e-bd4e-b89ad38074d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.549495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71b6825e-7bcc-401e-bd4e-b89ad38074d3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.562621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a582014b-24fb-491c-ae11-d351b0c68a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:11.563430 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582014b-24fb-491c-ae11-d351b0c68a79 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.563707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582014b-24fb-491c-ae11-d351b0c68a79 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.563974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a582014b-24fb-491c-ae11-d351b0c68a79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.574361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582014b-24fb-491c-ae11-d351b0c68a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:11.575834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a582014b-24fb-491c-ae11-d351b0c68a79 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a582014b-24fb-491c-ae11-d351b0c68a79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:11.595177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:11.596109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:11.597000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:11.597000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:11.597000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:11.597000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:11.597000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 312/630] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:11.597958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4ff5-e8bd-4834-9d70-52da3b69c7f9 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.598196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4ff5-e8bd-4834-9d70-52da3b69c7f9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.598466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7df4ff5-e8bd-4834-9d70-52da3b69c7f9 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.601869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 313/631] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:11 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:11.601869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4ff5-e8bd-4834-9d70-52da3b69c7f9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.629879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6825e-7bcc-401e-bd4e-b89ad38074d3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:11.631376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71b6825e-7bcc-401e-bd4e-b89ad38074d3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:11.715015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7df4ff5-e8bd-4834-9d70-52da3b69c7f9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:11.717789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:11.734207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 319/632] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:11.735593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6825e-7bcc-401e-bd4e-b89ad38074d3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.756947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b9aff57-9f02-4822-8528-413b9177f254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:11.757868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aff57-9f02-4822-8528-413b9177f254 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.758145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aff57-9f02-4822-8528-413b9177f254 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.758414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9aff57-9f02-4822-8528-413b9177f254 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.764099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:11.766768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9aff57-9f02-4822-8528-413b9177f254 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:11.768528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b9aff57-9f02-4822-8528-413b9177f254 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5b9aff57-9f02-4822-8528-413b9177f254 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:11.783216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:11.784157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:11.785068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 314/633] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:11.785937 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcff0a-5137-49ef-962d-675b07d078d2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.785937 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcff0a-5137-49ef-962d-675b07d078d2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.786198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9fcff0a-5137-49ef-962d-675b07d078d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.803995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d9fcff0a-5137-49ef-962d-675b07d078d2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:11.805194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d9fcff0a-5137-49ef-962d-675b07d078d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:11.846263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71b6825e-7bcc-401e-bd4e-b89ad38074d3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:11.883819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 315/634] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:11.883819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcff0a-5137-49ef-962d-675b07d078d2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.894882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:11.895788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:11.896077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:11.896355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:11.897470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:11.897776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:11.899733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:11.913065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 320/635] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:11.913936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:11.980933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:11.990216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9fcff0a-5137-49ef-962d-675b07d078d2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.014721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:12.028181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e7a193-5495-4cb8-9b70-e0cba5fa81c0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.030257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.031227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.031506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.031777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.042122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.043554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:12.063342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:12.064281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:12.065165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:12.065165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:12.065165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:12.065165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:12.065165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 316/636] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:12.065750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.066589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.067346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.067845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.068081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.069011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:12.069390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.070900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:12.082835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 321/637] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:12.083606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.171203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf0b2ee-5c1f-4e5a-b4a4-99f137d481a8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.183801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0934c00a-8e60-4608-b9d0-4bcba7809971 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.206955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81216d05-21da-409f-b1a9-d54ab225f322 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.207734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81216d05-21da-409f-b1a9-d54ab225f322 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.208021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81216d05-21da-409f-b1a9-d54ab225f322 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.208294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81216d05-21da-409f-b1a9-d54ab225f322 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.218100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81216d05-21da-409f-b1a9-d54ab225f322 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:12.218340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.219121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.219399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.219669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-81216d05-21da-409f-b1a9-d54ab225f322 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:12.225698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:12.226846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:12.227855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 317/638] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:12.228668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981395-f0ed-4ebe-a8c7-8156956c5f2f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.228668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981395-f0ed-4ebe-a8c7-8156956c5f2f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.228901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68981395-f0ed-4ebe-a8c7-8156956c5f2f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.229680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.230308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 318/639] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:12 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:12.230852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68981395-f0ed-4ebe-a8c7-8156956c5f2f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.231124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:12.240098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:12.248701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:12.249754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 322/640] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/users/cinder => generated 84 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:12.250713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.265180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:12.336007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68981395-f0ed-4ebe-a8c7-8156956c5f2f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.353289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b10a00f-074f-44e4-b477-38074143ae1b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.368838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.369521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.369802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.370080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.370797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:12.371102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.372479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:12.384658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 319/641] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:12.385449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.387311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6abef87-cf6f-4347-b031-d27d6456230d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.388903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abef87-cf6f-4347-b031-d27d6456230d None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.389323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abef87-cf6f-4347-b031-d27d6456230d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.389803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6abef87-cf6f-4347-b031-d27d6456230d None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/5de7841acf434c53a3c17ee73fae76e0/roles/48eb4b7efc744ce28a9b3dd160821614` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.404364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abef87-cf6f-4347-b031-d27d6456230d None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=5de7841acf434c53a3c17ee73fae76e0, role_id=48eb4b7efc744ce28a9b3dd160821614)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.405831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6abef87-cf6f-4347-b031-d27d6456230d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:12.420624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 323/642] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:12 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/5de7841acf434c53a3c17ee73fae76e0/roles/48eb4b7efc744ce28a9b3dd160821614 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:24:12.421784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7f99-5616-4798-a04d-e97474ef9585 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.422075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7f99-5616-4798-a04d-e97474ef9585 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.422355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93b7f99-5616-4798-a04d-e97474ef9585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.441980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c93b7f99-5616-4798-a04d-e97474ef9585 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:12.443229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c93b7f99-5616-4798-a04d-e97474ef9585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:12.466983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:12.509373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:12.511253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86aa552f-43fe-44f1-a7cc-4a50883dd677 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.524304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 324/643] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:12.525170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7f99-5616-4798-a04d-e97474ef9585 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.565586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.566658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.567113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.567580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.568630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:12.568931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.570321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:12.581379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 320/644] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:12.582132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.645521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93b7f99-5616-4798-a04d-e97474ef9585 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.687021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.687697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.688275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.688574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.689755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:12.690072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.691706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:12.712365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308325a9-17bb-4bd7-97ed-796033563c80 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.719883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 325/645] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:12.720814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.743138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:12.754734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.756387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.757171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.757731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.767073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.769333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:12.775000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:12.790477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:12.791473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:12.792517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:12.792517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:12.792517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:12.792517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:12.792517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:12.792517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:12.792517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:12.792517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:12.797623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 321/646] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:12.798502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.851343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ab239-3201-4e38-a387-13c7dd65541d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.914159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32d09c-fb0d-438f-b67c-979014efb89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.914981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32d09c-fb0d-438f-b67c-979014efb89d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.915251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32d09c-fb0d-438f-b67c-979014efb89d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.915636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed32d09c-fb0d-438f-b67c-979014efb89d None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.923573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8465b83b-931b-4a9b-9a85-2a40b6bd1af5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:12.935161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed32d09c-fb0d-438f-b67c-979014efb89d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ed32d09c-fb0d-438f-b67c-979014efb89d None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:12.946804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:12.947808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:12.948664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 326/647] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:12.949368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32d09c-fb0d-438f-b67c-979014efb89d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:12.977133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:12.978857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:12.979136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:12.979418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:12.996335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:12.998451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:13.022992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:13.023966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:13.024865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:13.024865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:13.024865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:13.024865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:13.030359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 322/648] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:13.031288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:13.087158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:13.096269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed32d09c-fb0d-438f-b67c-979014efb89d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.104569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:13.139346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a71b8-c155-4463-9005-b303b8d8cad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.140347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a71b8-c155-4463-9005-b303b8d8cad3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.140642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a71b8-c155-4463-9005-b303b8d8cad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.141058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-388a71b8-c155-4463-9005-b303b8d8cad3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.159714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608b7da-036f-4967-abf9-e21ed05be891 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.204389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.204978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.205262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.205573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.206399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:13.206723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:13.208162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:13.226661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 323/649] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:13.226661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:13.232474 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a71b8-c155-4463-9005-b303b8d8cad3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:13.234002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-388a71b8-c155-4463-9005-b303b8d8cad3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:13.335230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:13.338657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9da043a-03bb-4604-ac09-519a2ab05d31 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.366440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 327/650] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 418 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:13.367472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a71b8-c155-4463-9005-b303b8d8cad3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:13.379477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:13.384381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.385052 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.385338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.385687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.386367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:13.386670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:13.388044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:13.398056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 324/651] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:13.398785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:13.506915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-388a71b8-c155-4463-9005-b303b8d8cad3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.521018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8db701-d316-49c1-8f01-bc35ba7dbfb2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.548963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.550007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.550460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.550882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.551752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:13.552297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:13.553956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:13.560206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.560897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.561180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.561480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.562341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=1fe88851e1154cf0838e0cbe47459156) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:13.562879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:13.564654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:13.569934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 328/652] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:13.571029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:13.571141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 325/653] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:13 2022] GET /identity/v3/role_assignments?user.id=1fe88851e1154cf0838e0cbe47459156&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:13.571908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:13.620188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:13.671314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:13.716670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e24f857-2fe5-42f7-964d-996529eb6e5a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.740172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c6cad70-9b28-401f-aabc-e0e101f56b1e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.767526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.768931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.769622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.770206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.783512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.784639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.785148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.785651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.785855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:13.787312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:13.798871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:13.800595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:13.804841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:13.805891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:13.806797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:13.806797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:13.806797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:13.806797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:13.806797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 329/654] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:13.807070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:13.820372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:13.821289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:13.822384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:13.822384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:13.822384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:13.822384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:13.822384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 326/655] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:13.823268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:13.921594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:13.946241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2fc66f-2c25-4bac-a145-5956606e475f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.956092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd23a41f-b540-4709-ade1-8a7b91b788d5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:13.971019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:13.994453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.995319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:13.995658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.996113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:13.996322 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.996428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:13.996646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.997060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:13.998490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:13.998986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.000728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.005855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.007306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.015197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 327/656] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:14.016255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:14.033440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:14.034615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 330/657] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:14.035644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.147724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a6048-4b96-46e5-a0ef-c747dd2fe6b0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.158968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db346f1f-6ab7-4385-ac7d-1e12e754cc4f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.188853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.189682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.189962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.190236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.196901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.197458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.197796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.198145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.198485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.198910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.199354 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:14.199728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.201924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.208859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:14.214862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 328/658] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:14.215759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:14.219750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:14.221865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 331/659] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:14.224012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.269366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:14.321204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43964cdc-42a3-4c84-ad43-918352434d7d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.336152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674ff6d0-8c93-4462-af6f-b947f286c019 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.356098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.356769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.357774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.358056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.358894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:14.359204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.360624 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.374592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.375491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.375773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.376050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.379090 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 329/660] 10.222.0.20 () {56 vars in 1137 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:14.379992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.388637 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.390195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:14.407109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:14.409368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 12 08:24:14.411661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:14.417455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 332/661] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:14.417455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.446185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:14.491649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c025f33-99dd-44cf-8f7a-27e36604a0d2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.528004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.528378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:14.530043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.530700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.531128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.532073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:14.532539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.533206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1427cf-ea68-4622-a6cc-c6598d1700e1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.534356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.548273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 330/662] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:14.549451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.575395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0efb01f3-6ba7-4009-bbe8-79f9ddaab9e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.576070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb01f3-6ba7-4009-bbe8-79f9ddaab9e0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.576734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb01f3-6ba7-4009-bbe8-79f9ddaab9e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.577014 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0efb01f3-6ba7-4009-bbe8-79f9ddaab9e0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.661659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223fe71-2c15-4525-8aaf-690092999402 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.668282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb01f3-6ba7-4009-bbe8-79f9ddaab9e0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.670913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0efb01f3-6ba7-4009-bbe8-79f9ddaab9e0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.679891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:14.699885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.700707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.700990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.701264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.702300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:14.702589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.703956 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.725189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 331/663] 10.222.0.20 () {56 vars in 1139 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:14.726384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.774962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:14.785924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 333/664] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:14.787277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f11d-5174-48db-a3ed-add2fe92d0c5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.787931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f11d-5174-48db-a3ed-add2fe92d0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.788325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5820f11d-5174-48db-a3ed-add2fe92d0c5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.793827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 334/665] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:14 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:14.794615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f11d-5174-48db-a3ed-add2fe92d0c5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.836793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d408b8-1808-487d-a139-5f7e4312a93b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.875248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.875913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.876197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.876509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.877936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=91d8f3d11ef745d988fa2749f2a885ee) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:14.877936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:14.879071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:14.885535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 332/666] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/role_assignments?user.id=91d8f3d11ef745d988fa2749f2a885ee&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:14.894500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:14.912985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5820f11d-5174-48db-a3ed-add2fe92d0c5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:14.954059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fb54-d269-4377-8cfa-ff216e2045ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:14.954723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fb54-d269-4377-8cfa-ff216e2045ce None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:14.955006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fb54-d269-4377-8cfa-ff216e2045ce None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:14.955284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bc3fb54-d269-4377-8cfa-ff216e2045ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:14.957802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:15.035516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:15.040840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3fb54-d269-4377-8cfa-ff216e2045ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:15.042557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb0c09d-4191-4163-8fa7-5245976b0a6c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.043115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bc3fb54-d269-4377-8cfa-ff216e2045ce None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:15.084857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e0f325-535e-49d4-b5ce-30966294a77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:15.085763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0f325-535e-49d4-b5ce-30966294a77c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.086042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0f325-535e-49d4-b5ce-30966294a77c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.086317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e0f325-535e-49d4-b5ce-30966294a77c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.098362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0f325-535e-49d4-b5ce-30966294a77c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:15.099762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e0f325-535e-49d4-b5ce-30966294a77c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f5e0f325-535e-49d4-b5ce-30966294a77c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:15.122053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:15.123635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:15.124998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:15.124998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:15.124998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:15.124998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:15.124998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 333/667] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:15.125580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5da8b-bf4c-4c95-b325-8be53a05f09a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.125580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5da8b-bf4c-4c95-b325-8be53a05f09a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.125837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa5da8b-bf4c-4c95-b325-8be53a05f09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.150222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5aa5da8b-bf4c-4c95-b325-8be53a05f09a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:15.152200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5aa5da8b-bf4c-4c95-b325-8be53a05f09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:15.183153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 335/668] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 389 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:15.184073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fb54-d269-4377-8cfa-ff216e2045ce None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:15.245523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 334/669] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:15.246412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5da8b-bf4c-4c95-b325-8be53a05f09a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:15.282257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:15.313576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bc3fb54-d269-4377-8cfa-ff216e2045ce None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.350417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:15.372371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa5da8b-bf4c-4c95-b325-8be53a05f09a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.380509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:15.381568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.382420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.382906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.384134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:15.384886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:15.386647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:15.408167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 336/670] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:15.408167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:15.424608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:15.425411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.425718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.425989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.436566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:15.438117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:15.463590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:15.464543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:15.465443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:15.465443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:15.465443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:15.465443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:15.468261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 335/671] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:15.469454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:15.538347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ea8c0ef-a5bf-44e5-be5c-acf562572a19 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.567494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:15.581694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec875cf-d1c9-4d29-b37c-c3ee6891fc7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:15.582924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec875cf-d1c9-4d29-b37c-c3ee6891fc7c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.583723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec875cf-d1c9-4d29-b37c-c3ee6891fc7c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.584148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec875cf-d1c9-4d29-b37c-c3ee6891fc7c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.597639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec875cf-d1c9-4d29-b37c-c3ee6891fc7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:15.603020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f526189d-c602-47b0-97db-465ad852bf7e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1ec875cf-d1c9-4d29-b37c-c3ee6891fc7c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:15.608609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:15.609777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:15.610784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:15.618203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 337/672] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:15.618203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec875cf-d1c9-4d29-b37c-c3ee6891fc7c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:15.644546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:15.650770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:15.651638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.651907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.652169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.662558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:15.664234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:15.683205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:15.684130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:15.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:15.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:15.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:15.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:15.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:15.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:15.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:15.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:15.689312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 336/673] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:15.690203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:15.755227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec875cf-d1c9-4d29-b37c-c3ee6891fc7c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.799896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:15.801719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.802289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.802822 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.803946 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:15.804411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:15.806580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:15.814523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d387a338-42d3-4754-a08f-ff971f5d57c7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.829318 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 338/674] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:15.830347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:15.847915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:15.854309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:15.854902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.855215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.855445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.856199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:15.856638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:15.858471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:15.866813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 337/675] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:15.871819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:15.912426 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:15.935447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89fea748-23c2-4978-8a81-8435f3bf8044 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.970500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e1b48c-3bc3-49e6-9f7f-e0d0aee52902 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:15.971156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b48c-3bc3-49e6-9f7f-e0d0aee52902 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.971437 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b48c-3bc3-49e6-9f7f-e0d0aee52902 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.971712 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e1b48c-3bc3-49e6-9f7f-e0d0aee52902 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.972491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1b48c-3bc3-49e6-9f7f-e0d0aee52902 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:15.972802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1b48c-3bc3-49e6-9f7f-e0d0aee52902 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:15.974252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e1b48c-3bc3-49e6-9f7f-e0d0aee52902 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:15.978929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0bf3a01-8220-4176-ab99-e6f28eee05ff None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:15.991460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 339/676] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:15.991460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81c062-92be-424a-91f2-5c6478119e96 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:15.991460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81c062-92be-424a-91f2-5c6478119e96 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:15.991460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b81c062-92be-424a-91f2-5c6478119e96 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:15.991460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 340/677] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:15.991460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81c062-92be-424a-91f2-5c6478119e96 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.021589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.022374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.022650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.022921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.030843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:16.032285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:16.047186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:16.048520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 338/678] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:16.049470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.110715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:16.111875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b81c062-92be-424a-91f2-5c6478119e96 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:16.148429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48d9679-754c-4de1-bf6e-b704a47b7d1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.149237 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d9679-754c-4de1-bf6e-b704a47b7d1f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.149543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d9679-754c-4de1-bf6e-b704a47b7d1f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.149814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48d9679-754c-4de1-bf6e-b704a47b7d1f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.158837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03fbfd7f-fa92-4ed5-abdf-8623dd30d72f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:16.160279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:16.165045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d9679-754c-4de1-bf6e-b704a47b7d1f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:16.167159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48d9679-754c-4de1-bf6e-b704a47b7d1f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f48d9679-754c-4de1-bf6e-b704a47b7d1f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:16.188651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:16.189653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:16.190547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:16.190547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:16.190547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:16.190547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:16.190547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 341/679] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:16.191384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330cecf-72ca-4956-8208-2a94fa4a456a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.191660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330cecf-72ca-4956-8208-2a94fa4a456a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.191935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5330cecf-72ca-4956-8208-2a94fa4a456a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.200680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.201518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.201800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.202073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.203313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=993e107cc04e4ce6b9abd9997c29381f) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:16.203623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:16.205050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:16.207976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5330cecf-72ca-4956-8208-2a94fa4a456a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:16.209176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5330cecf-72ca-4956-8208-2a94fa4a456a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:16.211574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 339/680] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/role_assignments?user.id=993e107cc04e4ce6b9abd9997c29381f&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:16.212520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.304071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 342/681] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:16.305008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330cecf-72ca-4956-8208-2a94fa4a456a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.339706 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67a34b7-bd6b-4de4-a6e9-5d4e777a99dc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:16.360070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:16.379967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.380958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.381550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.382034 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.383071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:16.383630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:16.385277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:16.399361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 340/682] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:16.400905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.418998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5330cecf-72ca-4956-8208-2a94fa4a456a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:16.441977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:16.459960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.460627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.460911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.461325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.461950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:16.462265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:16.463630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:16.477969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 343/683] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:16.478623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.536766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86eff60-287c-4460-b843-268c39cd976f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:16.589570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348c7f-5fa5-4dbb-bfba-843aeb4dbd3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.590488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348c7f-5fa5-4dbb-bfba-843aeb4dbd3b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.591007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348c7f-5fa5-4dbb-bfba-843aeb4dbd3b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.592185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64348c7f-5fa5-4dbb-bfba-843aeb4dbd3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.597970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52225048-c1da-40f2-8d3d-24cb43dead44 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:16.605128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64348c7f-5fa5-4dbb-bfba-843aeb4dbd3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-64348c7f-5fa5-4dbb-bfba-843aeb4dbd3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:16.616872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:16.618038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:16.618889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:16.621557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 341/684] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/roles/admin => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:16.623576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348c7f-5fa5-4dbb-bfba-843aeb4dbd3b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.644579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.645356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.645680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.645958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.647127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=686a32aea0b945d9a76875110c8f84ca) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:16.647439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:16.648857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:16.658179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 344/685] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/role_assignments?user.id=686a32aea0b945d9a76875110c8f84ca&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:16.659600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.698089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:16.721989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:16.787791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ed75ba-df29-42b9-8593-360e08e304db None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:16.828831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.830022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.830302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.830576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.831338 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:16.831643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:16.833041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:16.844374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 345/686] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:16.850056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:16.850324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64348c7f-5fa5-4dbb-bfba-843aeb4dbd3b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:16.927180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:16.927899 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:16.928173 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:16.928439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:16.942696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:16.945201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:16.968439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:16.969470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:16.970450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:16.973651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 342/687] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/users/swift => generated 83 bytes in 351 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:16.979765 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.001893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a1de34-8d21-489a-b10b-15eb4699befa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.009484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:17.039158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ae2850-0411-438a-a60b-eb649b634c39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.040269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2850-0411-438a-a60b-eb649b634c39 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.040698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2850-0411-438a-a60b-eb649b634c39 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.041109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ae2850-0411-438a-a60b-eb649b634c39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.052631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae2850-0411-438a-a60b-eb649b634c39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.054453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ae2850-0411-438a-a60b-eb649b634c39 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-94ae2850-0411-438a-a60b-eb649b634c39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:17.074875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:17.075876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:17.076764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:17.076764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:17.076764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:17.076764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:17.078952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 346/688] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:17.080410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b384-6845-4497-9b17-60bb69438893 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.080686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b384-6845-4497-9b17-60bb69438893 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.080961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b574b384-6845-4497-9b17-60bb69438893 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.086287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 347/689] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:17.086287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574b384-6845-4497-9b17-60bb69438893 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.099419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:17.106377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6917d155-4f85-4bc5-9ea4-240ed5b5e141 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.152189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efee9e8f-0f13-4675-9e72-e4e92b0f5d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.152915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee9e8f-0f13-4675-9e72-e4e92b0f5d64 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.153201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee9e8f-0f13-4675-9e72-e4e92b0f5d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.153876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efee9e8f-0f13-4675-9e72-e4e92b0f5d64 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.155151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee9e8f-0f13-4675-9e72-e4e92b0f5d64 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:17.155465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee9e8f-0f13-4675-9e72-e4e92b0f5d64 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.157523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efee9e8f-0f13-4675-9e72-e4e92b0f5d64 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.182228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 343/690] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 12 08:24:16 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:17.183445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dac87-06fc-46ef-b374-ea712d732bc3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.183738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dac87-06fc-46ef-b374-ea712d732bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.184013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579dac87-06fc-46ef-b374-ea712d732bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.199679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b574b384-6845-4497-9b17-60bb69438893 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.206995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-579dac87-06fc-46ef-b374-ea712d732bc3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:17.208206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-579dac87-06fc-46ef-b374-ea712d732bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:17.236539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.237485 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.238109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.238551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.239417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:17.239868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.241385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.255167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 348/691] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:17.256322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.287138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:17.293353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 344/692] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:17.295043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dac87-06fc-46ef-b374-ea712d732bc3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.395656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ad884-5faf-4170-81d3-0c926d5e1ad7 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.400168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:17.428974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579dac87-06fc-46ef-b374-ea712d732bc3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.446129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0237db-fed9-4ab6-be39-1a0e399d8978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.447080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0237db-fed9-4ab6-be39-1a0e399d8978 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.447572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0237db-fed9-4ab6-be39-1a0e399d8978 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.448062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0237db-fed9-4ab6-be39-1a0e399d8978 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.467752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.468643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.468924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.469200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.477140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.478994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:17.494344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:17.495442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:17.496377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:17.500837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 345/693] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:17.501748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.525130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0237db-fed9-4ab6-be39-1a0e399d8978 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.527316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0237db-fed9-4ab6-be39-1a0e399d8978 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.546775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:17.615939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac828c2-fa98-43aa-b043-fcecb8d2cd60 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.636366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 349/694] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 380 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:17.637651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0237db-fed9-4ab6-be39-1a0e399d8978 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.658857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.659673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.659958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.660221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.660874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.662380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:17.678465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:17.679484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:17.680325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:17.684772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 346/695] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:17.685704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.699385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:17.746860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0237db-fed9-4ab6-be39-1a0e399d8978 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.764979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:17.783565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.784388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.784768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.785140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.786245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:17.786504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.788024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.799759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffdd3c3d-d77d-42d2-9023-e0053dc29618 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.810386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 350/696] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:17.810386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.841431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.842570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.843072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.843553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.855794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.858637 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:17.876933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:17.878065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:17.878954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:17.878954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:17.878954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:17.878954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:17.885448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 347/697] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:17.886514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.912961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57db3387-18e3-4039-8ecb-da8d48ba3359 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:17.948489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:17.949150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:17.949505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:17.949725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:17.950428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:17.951270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:17.952651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:17.961505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 351/698] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:17.961505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:17.963028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:18.006463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7db0c5-5c81-4957-8545-342364701454 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:18.007433 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:18.046973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0fd1-8482-470f-a40d-d5357c26f1e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:18.048158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0fd1-8482-470f-a40d-d5357c26f1e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.048644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0fd1-8482-470f-a40d-d5357c26f1e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.049224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7d0fd1-8482-470f-a40d-d5357c26f1e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.073238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b17d7e-3cb4-4312-8cad-f974e202c78e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:18.110621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:18.111282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.111563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.111840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.112664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:18.112974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:18.114529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:18.127384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d0fd1-8482-470f-a40d-d5357c26f1e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:18.129507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b7d0fd1-8482-470f-a40d-d5357c26f1e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:18.131897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 352/699] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:18.133271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:18.196712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:18.246848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a400b654-f771-4b2c-86f0-9ef26b738989 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:18.247186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 348/700] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 356 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:18.248294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:18.249120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0fd1-8482-470f-a40d-d5357c26f1e2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:18.286427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:18.287175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.287459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.287730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.288436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:18.288738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:18.290118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:18.301450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 353/701] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 12 08:24:18 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:18.301450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:18.444846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b7d0fd1-8482-470f-a40d-d5357c26f1e2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:18.469340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435773f1-3d0f-413e-800c-707ea3baf7da None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:18.521796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:18.522510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.522771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13f96bb9-fa09-4b39-ba5c-92c61b7684ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:18.522894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.523074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.523583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96bb9-fa09-4b39-ba5c-92c61b7684ac None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.523845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96bb9-fa09-4b39-ba5c-92c61b7684ac None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.524115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13f96bb9-fa09-4b39-ba5c-92c61b7684ac None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.534240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f96bb9-fa09-4b39-ba5c-92c61b7684ac None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:18.535843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13f96bb9-fa09-4b39-ba5c-92c61b7684ac None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:18.540780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:18.542289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-13f96bb9-fa09-4b39-ba5c-92c61b7684ac None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:18.554583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:18.555595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:18.556501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 349/702] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:18.562444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:18.563323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:18.564265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:18.564265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:18.564265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:18.564265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:18.564265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 354/703] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:18.564953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:18.565513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f992c-d7e0-4fd1-96c9-26a5518aff11 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.566014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f992c-d7e0-4fd1-96c9-26a5518aff11 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.566503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391f992c-d7e0-4fd1-96c9-26a5518aff11 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.569736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 350/704] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:18 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:18.570768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f992c-d7e0-4fd1-96c9-26a5518aff11 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:18.589217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:18.606087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:18.694812 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5f5ccf-65c8-4ee9-8453-60d8accbd85b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:18.701842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391f992c-d7e0-4fd1-96c9-26a5518aff11 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:18.738189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f341b7d9-53d9-4ebe-ba96-834ba848618c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:18.739391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b7d9-53d9-4ebe-ba96-834ba848618c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.740013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b7d9-53d9-4ebe-ba96-834ba848618c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.740542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f341b7d9-53d9-4ebe-ba96-834ba848618c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.741219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:18.741676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341b7d9-53d9-4ebe-ba96-834ba848618c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:18.742033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.742384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.742500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341b7d9-53d9-4ebe-ba96-834ba848618c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:18.742737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.743587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:18.743977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:18.744643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f341b7d9-53d9-4ebe-ba96-834ba848618c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:18.747452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:18.759933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 351/705] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:18.761548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bea7ac-a357-4b11-a813-de5a24297979 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.762046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bea7ac-a357-4b11-a813-de5a24297979 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.762357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 355/706] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:18.762704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87bea7ac-a357-4b11-a813-de5a24297979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.765446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:18.780337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-87bea7ac-a357-4b11-a813-de5a24297979 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:18.783185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-87bea7ac-a357-4b11-a813-de5a24297979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:18.854699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:18.855796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 352/707] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:18.857390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bea7ac-a357-4b11-a813-de5a24297979 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:18.879710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2698d8da-2947-4c7a-840d-65907e44bf99 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:18.909992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:18.915762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:18.916562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:18.916847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:18.917129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:18.925449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:18.926866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:18.942532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:18.943459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:18.944392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 356/708] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:18.944938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:18.977159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87bea7ac-a357-4b11-a813-de5a24297979 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:19.015573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:19.016616 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.017101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.017658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.018771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=5de7841acf434c53a3c17ee73fae76e0) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:19.019326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:19.020962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:19.028254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 353/709] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:18 2022] GET /identity/v3/role_assignments?user.id=5de7841acf434c53a3c17ee73fae76e0&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 608 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:19.030608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:19.056199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e05a34-2c0a-4c1a-9efc-42efe0bd8a76 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:19.095579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a429f34-3ff8-4e9d-a2b4-69731e0a4fa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:19.096393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429f34-3ff8-4e9d-a2b4-69731e0a4fa1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.096675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429f34-3ff8-4e9d-a2b4-69731e0a4fa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.096965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a429f34-3ff8-4e9d-a2b4-69731e0a4fa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.104878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:19.109535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429f34-3ff8-4e9d-a2b4-69731e0a4fa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:19.111187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a429f34-3ff8-4e9d-a2b4-69731e0a4fa1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:19.125997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6a429f34-3ff8-4e9d-a2b4-69731e0a4fa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:19.132963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:19.134061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:19.135028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:19.135028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:19.135028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:19.135028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:19.137577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 357/710] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:19.139625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950af8-1e61-4e61-b7f5-1a4c69ae3b81 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.140923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950af8-1e61-4e61-b7f5-1a4c69ae3b81 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.141452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78950af8-1e61-4e61-b7f5-1a4c69ae3b81 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.143305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 358/711] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:19.144388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78950af8-1e61-4e61-b7f5-1a4c69ae3b81 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:19.155526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569f8db7-27c0-444f-9339-15a2cc6a79fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:19.195696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af496cfb-93c4-4c20-8f5c-7b51384e38aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:19.196404 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af496cfb-93c4-4c20-8f5c-7b51384e38aa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.197036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af496cfb-93c4-4c20-8f5c-7b51384e38aa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.197036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af496cfb-93c4-4c20-8f5c-7b51384e38aa None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.197784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af496cfb-93c4-4c20-8f5c-7b51384e38aa None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:19.198097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af496cfb-93c4-4c20-8f5c-7b51384e38aa None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:19.199589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af496cfb-93c4-4c20-8f5c-7b51384e38aa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:19.213773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 354/712] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:19 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:19.215094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e822f7-0fdf-42d8-a174-fdc5248f270c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.215382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e822f7-0fdf-42d8-a174-fdc5248f270c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.215660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2e822f7-0fdf-42d8-a174-fdc5248f270c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.236542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c2e822f7-0fdf-42d8-a174-fdc5248f270c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:19.237789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c2e822f7-0fdf-42d8-a174-fdc5248f270c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:19.280914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78950af8-1e61-4e61-b7f5-1a4c69ae3b81 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:19.323450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:19.324120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.324403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.324677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.325396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:19.326284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:19.327796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:19.329786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 355/713] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:19.330634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e822f7-0fdf-42d8-a174-fdc5248f270c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:19.340172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 359/714] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:19.345632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:19.408644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:19.415608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:19.469431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2e822f7-0fdf-42d8-a174-fdc5248f270c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:19.474269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ba4ae-bf57-4425-bc02-7441d239a540 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:19.511932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c598282-8486-4175-a113-504d7f30be2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:19.512840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c598282-8486-4175-a113-504d7f30be2b None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.513308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c598282-8486-4175-a113-504d7f30be2b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.513990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c598282-8486-4175-a113-504d7f30be2b None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.514345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:19.515007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.515199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c598282-8486-4175-a113-504d7f30be2b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:19.515306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.515551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.516384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=1fe88851e1154cf0838e0cbe47459156) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:19.516692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:19.517353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c598282-8486-4175-a113-504d7f30be2b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:19.518148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:19.525741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 356/715] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:19 2022] GET /identity/v3/role_assignments?user.id=1fe88851e1154cf0838e0cbe47459156&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 259 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:19.526800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:19.556965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 360/716] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:24:19 2022] POST /identity/v3/users => generated 254 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:19.691619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5492982-29c9-4f91-8e7c-dba309bba518 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:19.742044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:19.749534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:19.750694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.751159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.751610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.752460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:19.754084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:19.768954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:19.770066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:19.770921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:19.773474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 357/717] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:19 2022] GET /identity/v3/services/network => generated 88 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:19.782661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c598282-8486-4175-a113-504d7f30be2b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:19.906366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c598282-8486-4175-a113-504d7f30be2b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:19.908645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:19.947137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f09984b-4cca-4e42-969f-3809075a6ee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:19.947829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09984b-4cca-4e42-969f-3809075a6ee8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:19.948067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09984b-4cca-4e42-969f-3809075a6ee8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:19.948334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f09984b-4cca-4e42-969f-3809075a6ee8 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:19.949040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09984b-4cca-4e42-969f-3809075a6ee8 None admin] RBAC: Adding query filter params (name=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:19.949341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09984b-4cca-4e42-969f-3809075a6ee8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:19.951350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f09984b-4cca-4e42-969f-3809075a6ee8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:19.961574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 361/718] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:19 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:19.962906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:20.081109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ceff5e-1b91-438d-8066-dcb5f0a0fd7e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:20.118978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6539179e-d4e4-414d-be9d-c48f10aadabf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:20.119645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539179e-d4e4-414d-be9d-c48f10aadabf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:20.119975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539179e-d4e4-414d-be9d-c48f10aadabf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:20.120256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6539179e-d4e4-414d-be9d-c48f10aadabf None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:20.120966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539179e-d4e4-414d-be9d-c48f10aadabf None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:20.121273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539179e-d4e4-414d-be9d-c48f10aadabf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:20.123023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6539179e-d4e4-414d-be9d-c48f10aadabf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:20.130020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 358/719] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:19 2022] GET /identity/v3/services?type=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:20.740198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eaf37-aeae-402d-bebc-b2289dca391f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:20.740550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eaf37-aeae-402d-bebc-b2289dca391f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:20.740734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f8eaf37-aeae-402d-bebc-b2289dca391f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:20.742429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 362/720] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:20.748036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8cf2-c0b6-4fd7-80bf-1b40e9357751 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:20.748605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8cf2-c0b6-4fd7-80bf-1b40e9357751 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:20.748605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b74a8cf2-c0b6-4fd7-80bf-1b40e9357751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:20.777053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b74a8cf2-c0b6-4fd7-80bf-1b40e9357751 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:20.778252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b74a8cf2-c0b6-4fd7-80bf-1b40e9357751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:20.860271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:20.882212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 359/721] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 12 08:24:20.922571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eaf37-aeae-402d-bebc-b2289dca391f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:21.046742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f8eaf37-aeae-402d-bebc-b2289dca391f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:21.083589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93230a5f-4d17-4502-8d46-511e8ce59af1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:21.084650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230a5f-4d17-4502-8d46-511e8ce59af1 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:21.085139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230a5f-4d17-4502-8d46-511e8ce59af1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:21.085640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93230a5f-4d17-4502-8d46-511e8ce59af1 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:21.086571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230a5f-4d17-4502-8d46-511e8ce59af1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:21.088129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93230a5f-4d17-4502-8d46-511e8ce59af1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:21.104703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 363/722] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:24:20 2022] POST /identity/v3/services => generated 251 bytes in 183 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:21.635578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771121e-1289-46db-afcd-925ce230b0d5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:21.635950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771121e-1289-46db-afcd-925ce230b0d5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:21.636134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5771121e-1289-46db-afcd-925ce230b0d5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:21.637772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 360/723] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:21.644354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021c26-ad0a-4194-92e5-d4bd0ae50b35 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:21.644641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021c26-ad0a-4194-92e5-d4bd0ae50b35 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:21.644994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11021c26-ad0a-4194-92e5-d4bd0ae50b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:21.664599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-11021c26-ad0a-4194-92e5-d4bd0ae50b35 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:21.665752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-11021c26-ad0a-4194-92e5-d4bd0ae50b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:21.692550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:21.771642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 364/724] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:21.807774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771121e-1289-46db-afcd-925ce230b0d5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:21.876758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef67e-46d1-4c96-93b0-60f44e021f24 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:21.877405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef67e-46d1-4c96-93b0-60f44e021f24 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:21.877956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a74ef67e-46d1-4c96-93b0-60f44e021f24 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:21.879821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 365/725] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:21.884791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f60a8-0d24-4f92-9e1c-d8bbc642011a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:21.885080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f60a8-0d24-4f92-9e1c-d8bbc642011a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:21.885360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f60a8-0d24-4f92-9e1c-d8bbc642011a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:21.922548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-865f60a8-0d24-4f92-9e1c-d8bbc642011a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:21.923677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-865f60a8-0d24-4f92-9e1c-d8bbc642011a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:21.927920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5771121e-1289-46db-afcd-925ce230b0d5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:21.969485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3336d-a52d-4aa9-aa11-b404dc38ea96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:21.970288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3336d-a52d-4aa9-aa11-b404dc38ea96 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:21.970559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3336d-a52d-4aa9-aa11-b404dc38ea96 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:21.970855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84d3336d-a52d-4aa9-aa11-b404dc38ea96 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:21.983560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84d3336d-a52d-4aa9-aa11-b404dc38ea96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-84d3336d-a52d-4aa9-aa11-b404dc38ea96 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:21.992712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:21.993735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:21.994564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 361/726] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:21 2022] GET /identity/v3/roles/admin => generated 83 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:22.000468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3336d-a52d-4aa9-aa11-b404dc38ea96 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:22.058751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:22.095220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 366/727] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:21 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:22.119098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84d3336d-a52d-4aa9-aa11-b404dc38ea96 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:22.139521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f60a8-0d24-4f92-9e1c-d8bbc642011a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:22.159118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:22.159794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.160075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.160800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.161598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:22.161908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:22.163292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:22.173917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 362/728] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:21 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:22.178749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:22.316871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf098f6-3e00-49d3-89c8-433607bc2895 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:22.339303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:22.363939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:22.377452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddcf8d44-904f-4e84-96c0-792e40abdd41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:22.378264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf8d44-904f-4e84-96c0-792e40abdd41 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.378550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf8d44-904f-4e84-96c0-792e40abdd41 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.378829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddcf8d44-904f-4e84-96c0-792e40abdd41 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.398426 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f60a8-0d24-4f92-9e1c-d8bbc642011a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:22.401114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf8d44-904f-4e84-96c0-792e40abdd41 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:22.402617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddcf8d44-904f-4e84-96c0-792e40abdd41 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ddcf8d44-904f-4e84-96c0-792e40abdd41 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:22.436941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:22.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:22.438804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:22.438804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:22.438804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:22.438804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:22.441087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 363/729] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:22.442649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7541-3aa7-4d6e-a452-d806d07d708c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.443175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7541-3aa7-4d6e-a452-d806d07d708c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.443678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271f7541-3aa7-4d6e-a452-d806d07d708c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.445386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 364/730] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:22.446291 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f7541-3aa7-4d6e-a452-d806d07d708c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:22.464653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f5d429-be77-475e-b60e-8b763044bcb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:22.465463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5d429-be77-475e-b60e-8b763044bcb3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.465748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5d429-be77-475e-b60e-8b763044bcb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.466599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f5d429-be77-475e-b60e-8b763044bcb3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.477371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f5d429-be77-475e-b60e-8b763044bcb3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-38f5d429-be77-475e-b60e-8b763044bcb3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:22.485224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:22.486236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:22.487067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 367/731] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:22.488270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fb4be-b070-4cc0-ba3c-94197f84418c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.488270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fb4be-b070-4cc0-ba3c-94197f84418c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.488526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5fb4be-b070-4cc0-ba3c-94197f84418c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.505684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8f5fb4be-b070-4cc0-ba3c-94197f84418c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:22.506612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8f5fb4be-b070-4cc0-ba3c-94197f84418c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:22.584461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271f7541-3aa7-4d6e-a452-d806d07d708c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:22.589660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 368/732] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:22 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:22.590548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fb4be-b070-4cc0-ba3c-94197f84418c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:22.627231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:22.628856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.629662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.630144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.631695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:22.632462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:22.634753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:22.655526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 365/733] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:22.656472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:22.681956 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:22.706376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:22.739634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5fb4be-b070-4cc0-ba3c-94197f84418c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:22.774985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d3e9cf-81a8-4ee5-bead-6e8142850229 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:22.781599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:22.782499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.782957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.783403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.784792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:22.785292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:22.787338 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:22.798828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 369/734] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:22.800506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:22.816355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46ac3-3b1a-4a6a-b2ba-2ad3b9c42fda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:22.817183 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46ac3-3b1a-4a6a-b2ba-2ad3b9c42fda None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.817499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46ac3-3b1a-4a6a-b2ba-2ad3b9c42fda None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.817774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76a46ac3-3b1a-4a6a-b2ba-2ad3b9c42fda None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.829718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76a46ac3-3b1a-4a6a-b2ba-2ad3b9c42fda None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-76a46ac3-3b1a-4a6a-b2ba-2ad3b9c42fda None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:22.837369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:22.838306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:22.839149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 366/735] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:22 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:22.839832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46ac3-3b1a-4a6a-b2ba-2ad3b9c42fda None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:22.923149 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6008d64-27c4-4c5b-a346-29434b5ae3a0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:22.926186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:22.949777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76a46ac3-3b1a-4a6a-b2ba-2ad3b9c42fda None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:22.957115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d876b55-a140-4c0b-8e61-870f62c92569 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:22.957881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d876b55-a140-4c0b-8e61-870f62c92569 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.958160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d876b55-a140-4c0b-8e61-870f62c92569 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.958433 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d876b55-a140-4c0b-8e61-870f62c92569 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.961642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:22.968545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d876b55-a140-4c0b-8e61-870f62c92569 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:22.970371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d876b55-a140-4c0b-8e61-870f62c92569 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4d876b55-a140-4c0b-8e61-870f62c92569 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:22.985380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:22.986383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:22.987350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:22.989823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:22.990614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.990908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.991482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.991584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 370/736] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:22 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:22.992398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b336e-e2bd-4dfd-ac23-d285dac916f8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:22.992679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b336e-e2bd-4dfd-ac23-d285dac916f8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:22.992957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4b336e-e2bd-4dfd-ac23-d285dac916f8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:22.994363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 371/737] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:22.994915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b336e-e2bd-4dfd-ac23-d285dac916f8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.003651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.005457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:23.023319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:23.024217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:23.025111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:23.025111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:23.025111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:23.025111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:23.026910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 367/738] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:23.027830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.111096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4b336e-e2bd-4dfd-ac23-d285dac916f8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:23.137380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d94786-4e3a-4b33-805a-cb69e46065a3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:23.147998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e833462-d9ce-4917-861e-c28a67befda3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:23.148658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e833462-d9ce-4917-861e-c28a67befda3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.149025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e833462-d9ce-4917-861e-c28a67befda3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.149306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e833462-d9ce-4917-861e-c28a67befda3 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.150078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e833462-d9ce-4917-861e-c28a67befda3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:23.150388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e833462-d9ce-4917-861e-c28a67befda3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.151997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e833462-d9ce-4917-861e-c28a67befda3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.165340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 372/739] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:23.165340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48e81-b82b-4ff4-8d52-942d7641cee8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.165340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48e81-b82b-4ff4-8d52-942d7641cee8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.165340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed48e81-b82b-4ff4-8d52-942d7641cee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.178789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:23.179551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.179900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.180320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.181156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:23.181399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3ed48e81-b82b-4ff4-8d52-942d7641cee8 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:23.181524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.182626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3ed48e81-b82b-4ff4-8d52-942d7641cee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:23.182894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.184793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:23.207774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 368/740] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 12 08:24:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:23.207774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.243115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:23.261482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 373/741] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:23 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 12 08:24:23.261482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed48e81-b82b-4ff4-8d52-942d7641cee8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.320709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-149a2903-e7fb-4d11-936d-c8863a95bea9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:23.357299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:23.357982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.358259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.358529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.359357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:23.359659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.361117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.374181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 369/742] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:23.374990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.380683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed48e81-b82b-4ff4-8d52-942d7641cee8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:23.420540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:23.420540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.420540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.420540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.430978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.432445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.437586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:23.451603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:23.452532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:23.453405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:23.453405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:23.453405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:23.453405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:23.453405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 374/743] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:23.453732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.492015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d3f1e1-b6dc-4531-a35c-8881a786b68d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:23.499650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:23.530754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f2b56-ad33-4f80-b293-01ba179463e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:23.531679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2b56-ad33-4f80-b293-01ba179463e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.532103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2b56-ad33-4f80-b293-01ba179463e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.532513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e69f2b56-ad33-4f80-b293-01ba179463e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.564843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30caaae2-d8f5-4da5-8e87-0d32c4642232 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:23.601218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d685dea-0c05-4a38-b6dc-5576bc2a1c37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:23.601909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d685dea-0c05-4a38-b6dc-5576bc2a1c37 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.602350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d685dea-0c05-4a38-b6dc-5576bc2a1c37 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.602632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d685dea-0c05-4a38-b6dc-5576bc2a1c37 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.603861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d685dea-0c05-4a38-b6dc-5576bc2a1c37 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.605231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f2b56-ad33-4f80-b293-01ba179463e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.605358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d685dea-0c05-4a38-b6dc-5576bc2a1c37 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.606791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e69f2b56-ad33-4f80-b293-01ba179463e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.621098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 375/744] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:24:23 2022] POST /identity/v3/services => generated 240 bytes in 168 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:23.627196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d685dea-0c05-4a38-b6dc-5576bc2a1c37 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.683887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:23.746480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 370/745] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:23 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 12 08:24:23.746480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f2b56-ad33-4f80-b293-01ba179463e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.772730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:23.784170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d685dea-0c05-4a38-b6dc-5576bc2a1c37 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:23.822791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:23.823577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.823852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.824123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.831397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.832832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:23.847214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:23.848187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 376/746] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:24:23 2022] GET /identity/v3/users/nova => generated 82 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:23.849139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.869447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e69f2b56-ad33-4f80-b293-01ba179463e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:23.904973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6ec869-afd8-4027-94bc-4a7ef7f57b2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:23.905646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec869-afd8-4027-94bc-4a7ef7f57b2c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.905924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec869-afd8-4027-94bc-4a7ef7f57b2c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.906194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6ec869-afd8-4027-94bc-4a7ef7f57b2c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.906906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ec869-afd8-4027-94bc-4a7ef7f57b2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:23.907207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ec869-afd8-4027-94bc-4a7ef7f57b2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:23.908552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6ec869-afd8-4027-94bc-4a7ef7f57b2c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:23.923933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 371/747] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:23.923933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d793d-04c4-4f22-839b-63b6be8b817e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:23.923933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d793d-04c4-4f22-839b-63b6be8b817e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:23.923933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d793d-04c4-4f22-839b-63b6be8b817e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:23.923933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 372/748] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:23.923933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d793d-04c4-4f22-839b-63b6be8b817e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:23.941170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:23.967494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6add97-1bde-447d-8816-7623224a0f0d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.006718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.007421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.007747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.008362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.020022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.021481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.036119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d793d-04c4-4f22-839b-63b6be8b817e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:24.039976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:24.040853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:24.042145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:24.042145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:24.042145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:24.042145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:24.042145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 377/749] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:24.042432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.054563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:24.077697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21df4b7-c1c2-42c5-a7db-ff84a0f4d2a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.078363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21df4b7-c1c2-42c5-a7db-ff84a0f4d2a0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.078642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21df4b7-c1c2-42c5-a7db-ff84a0f4d2a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.078966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21df4b7-c1c2-42c5-a7db-ff84a0f4d2a0 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.079734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21df4b7-c1c2-42c5-a7db-ff84a0f4d2a0 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:24.080672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21df4b7-c1c2-42c5-a7db-ff84a0f4d2a0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.081468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21df4b7-c1c2-42c5-a7db-ff84a0f4d2a0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.099236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 373/750] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:24:23 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:24.100477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82437-b47a-4db0-9ea3-5ee73bccf145 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.100761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82437-b47a-4db0-9ea3-5ee73bccf145 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.101030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46b82437-b47a-4db0-9ea3-5ee73bccf145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.120985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-46b82437-b47a-4db0-9ea3-5ee73bccf145 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:24.123421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-46b82437-b47a-4db0-9ea3-5ee73bccf145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:24.154394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed5d9b8-0cc2-4446-a1c5-58b858648421 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.190562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:24.191413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.192221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.192515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.192801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.197756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 374/751] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:24 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:24.198849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b82437-b47a-4db0-9ea3-5ee73bccf145 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.201322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.202803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:24.221132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:24.222379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 378/752] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:24.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.293599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:24.318413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46b82437-b47a-4db0-9ea3-5ee73bccf145 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.327495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99867f6a-e82e-483d-a0e5-0b143eca0131 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.356233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.357672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.357952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.358225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.358933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:24.359292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.360597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.362269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.363050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.363327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.363595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.375975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.375975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.378415 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 375/753] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:24.379295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:24.393952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:24.394874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:24.395798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:24.395798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:24.395798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:24.395798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:24.395798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 379/754] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:24.396715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.448017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:24.491114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a926aad9-9462-4c53-abc3-fcfa626c70a3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.510831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc7a237-c881-4bb9-a3d9-6045b09f4620 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.527316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.528130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.528479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.528757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.529407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.530799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.535215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:24.542742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:24.543698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:24.545185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 376/755] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:24.546094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.557473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.558404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.558907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.559404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.561265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:24.561665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.563093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.587053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 380/756] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:24.587905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.653004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953136dd-17e9-477d-aafa-c258d7c3b568 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.677740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:24.690143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.690942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.691225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.691502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.698259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.698842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30577600-5367-4491-9bda-ae3d25239f33 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.699701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:24.714734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:24.715836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:24.716795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 377/757] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:24.717296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.742981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.743802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.744192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.744561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.745390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:24.745844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.748038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.761370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 381/758] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:24.762502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.805597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:24.833658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ed98f7-ccb8-4004-974f-8d6485779480 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.866321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ab12d8-359f-41eb-94c4-189e90c5ac55 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:24.867748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.868395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.868671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.868939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.869661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:24.870222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.871306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.876360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 378/759] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:24.877129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:24.907729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae2b6c-fbc0-44c3-ae10-adc6fe7c8d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:24.908376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2b6c-fbc0-44c3-ae10-adc6fe7c8d41 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:24.908656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2b6c-fbc0-44c3-ae10-adc6fe7c8d41 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:24.908934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41ae2b6c-fbc0-44c3-ae10-adc6fe7c8d41 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:24.927010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:24.980329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae2b6c-fbc0-44c3-ae10-adc6fe7c8d41 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:24.982506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41ae2b6c-fbc0-44c3-ae10-adc6fe7c8d41 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:24.987983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c772212-0e8a-4038-b7c4-82f3a3cada13 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.026022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.026697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.026981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.027255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.028055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:25.028361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.030374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.049802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 379/760] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:25.049802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.142455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:25.159801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd10da8c-e33c-47be-bbcb-1e3fd6e5a63c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.169689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:25.196361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.197147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.197444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.197723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.205085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.206558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.209549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 382/761] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:24 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 447 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:24:25.210925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae2b6c-fbc0-44c3-ae10-adc6fe7c8d41 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:25.221888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:25.222809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:25.223685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 380/762] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:25.224162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.323328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41ae2b6c-fbc0-44c3-ae10-adc6fe7c8d41 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.343069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c1c321-218e-42bf-85b5-3c399ae1ec91 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.360195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.360855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.361127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.361397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.362127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:25.362427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.363775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.368816 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 383/763] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 12 08:24:25 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:25.369623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.372084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:25.383504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.384158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.384435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.384865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.385564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=5de7841acf434c53a3c17ee73fae76e0) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:25.385864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.387303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.393743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 381/764] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:25 2022] GET /identity/v3/role_assignments?user.id=5de7841acf434c53a3c17ee73fae76e0&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:25.394392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.443343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:25.516837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a152e1d-01b4-4a75-92e2-b127a738d372 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.523808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a534a2c-879b-4146-bda5-f6d5bf2ab3f6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.562754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.563705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.564128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.564528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.564974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.565675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:25.565855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.566123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.566406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.566862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.569760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.579018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.580464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.589205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 382/765] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:25.590157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:25.605582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:25.606562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:25.607612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:25.607612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:25.607612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:25.607612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:25.611588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 384/766] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:25.612413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.680494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:25.698764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:25.711347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f8bacf-ccfb-4f62-88d2-9de5f1d255a8 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.732381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85c8cbd-01ca-48ee-b35a-0d1303a13706 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.746935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.748190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.748494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.748684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.749697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] RBAC: Adding query filter params (interface=public, service_id=7edae71c5add4a4caf4bed30768b6f68, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:25.749915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.751288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.759609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 383/767] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 12 08:24:25 2022] GET /identity/v3/endpoints?service_id=7edae71c5add4a4caf4bed30768b6f68&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:25.760411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.773882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9f4d1d-2914-4cde-87a0-8ea25b98978d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.775010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4d1d-2914-4cde-87a0-8ea25b98978d None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.775725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4d1d-2914-4cde-87a0-8ea25b98978d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.776161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9f4d1d-2914-4cde-87a0-8ea25b98978d None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/1fe88851e1154cf0838e0cbe47459156/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.778410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4d1d-2914-4cde-87a0-8ea25b98978d None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=1fe88851e1154cf0838e0cbe47459156, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.780035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9f4d1d-2914-4cde-87a0-8ea25b98978d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.801528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 385/768] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:25 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/1fe88851e1154cf0838e0cbe47459156/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:24:25.804228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7a43-9885-44e4-b816-243ff9e1977e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.804871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7a43-9885-44e4-b816-243ff9e1977e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.805402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644d7a43-9885-44e4-b816-243ff9e1977e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.808607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 386/769] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:25 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:25.810496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d7a43-9885-44e4-b816-243ff9e1977e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:25.878164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc1fe8-4473-4485-8fe1-2e91404690f7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.917380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dbfdda-997b-4665-9d58-4921c0949e0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:25.918119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbfdda-997b-4665-9d58-4921c0949e0a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.918404 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbfdda-997b-4665-9d58-4921c0949e0a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.918680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dbfdda-997b-4665-9d58-4921c0949e0a None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.919526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbfdda-997b-4665-9d58-4921c0949e0a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:25.919832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbfdda-997b-4665-9d58-4921c0949e0a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:25.921347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dbfdda-997b-4665-9d58-4921c0949e0a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:25.937989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 384/770] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:25.939838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43579117-24cb-4e36-925b-dbb352faaf68 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:25.940273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43579117-24cb-4e36-925b-dbb352faaf68 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:25.940708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43579117-24cb-4e36-925b-dbb352faaf68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:25.959990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-43579117-24cb-4e36-925b-dbb352faaf68 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:25.961544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-43579117-24cb-4e36-925b-dbb352faaf68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:25.962895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-644d7a43-9885-44e4-b816-243ff9e1977e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:25.975189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:25.984253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:26.017011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc03a5-3a83-4eb4-84f0-9e68267ef453 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:26.017255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc03a5-3a83-4eb4-84f0-9e68267ef453 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:26.017908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc03a5-3a83-4eb4-84f0-9e68267ef453 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:26.017908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14dc03a5-3a83-4eb4-84f0-9e68267ef453 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:26.018830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc03a5-3a83-4eb4-84f0-9e68267ef453 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:26.020605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14dc03a5-3a83-4eb4-84f0-9e68267ef453 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:26.033917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 387/771] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:24:25 2022] GET /identity/v3/services => generated 772 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:26.034882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc03a5-3a83-4eb4-84f0-9e68267ef453 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:26.048192 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 385/772] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:25 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:26.084812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43579117-24cb-4e36-925b-dbb352faaf68 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:26.214066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14dc03a5-3a83-4eb4-84f0-9e68267ef453 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:26.252803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43579117-24cb-4e36-925b-dbb352faaf68 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:26.263350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:26.264204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:26.264595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:26.264870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:26.273632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:26.275081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:26.291850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:26.292751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:26.293648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 388/773] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 259 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:26.298669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:26.299079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:26.299885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:26.300172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:26.300446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] PATH_INFO: `/v3/services/network` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:26.301103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:26.302776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:26.319608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:26.321589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:26.322729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 386/774] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:26 2022] GET /identity/v3/services/network => generated 88 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:26.330532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:26.354571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:26.356260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:26.481734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f22332-e31f-4ff2-b1d9-94ce72af1091 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:26.518239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:26.519271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:26.519747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:26.520223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:26.521197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:26.521734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:26.523357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:26.535555 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac14e70-58d8-4989-96fd-75b46f29b12b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:26.537266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 389/775] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:26.546410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:26.606288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:26.607544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:26.607819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:26.608239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:26.608859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] RBAC: Adding query filter params (name=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:26.609209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:26.610727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:26.617854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 387/776] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:26 2022] GET /identity/v3/services?name=network => generated 124 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:26.626866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:26.670039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:26.672289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00da61e3-ccad-4ded-bfab-c785abb70b31 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:26.711455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:26.712479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:26.712971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:26.713450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:26.714471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=b46349b7039e4161ac7f9ac2e477a9d9) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:26.714996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:26.717325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:26.723640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 390/777] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:26 2022] GET /identity/v3/role_assignments?user.id=b46349b7039e4161ac7f9ac2e477a9d9&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:26.769914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:26.812121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd46be8-1bdb-44b5-83c3-80d5ec11214c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:26.868880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:26.869848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:26.870271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:26.870682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:26.871519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:26.871982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:26.873694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:26.882300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 388/778] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:26 2022] GET /identity/v3/services?type=network => generated 350 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:26.889154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:27.000446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db30a14-d9b9-49a3-a283-795942f44153 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:27.044748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0577ba0f-e2cb-438c-ab96-332032ba6b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:27.050165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ba0f-e2cb-438c-ab96-332032ba6b04 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:27.050600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ba0f-e2cb-438c-ab96-332032ba6b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:27.051014 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0577ba0f-e2cb-438c-ab96-332032ba6b04 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:27.051943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577ba0f-e2cb-438c-ab96-332032ba6b04 None admin] RBAC: Adding query filter params (interface=public, service_id=6fa19532ab3f42799e4365928921e806, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:27.052492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577ba0f-e2cb-438c-ab96-332032ba6b04 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:27.054012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0577ba0f-e2cb-438c-ab96-332032ba6b04 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:27.062476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 391/779] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 12 08:24:26 2022] GET /identity/v3/endpoints?service_id=6fa19532ab3f42799e4365928921e806&interface=public®ion_id=RegionOne => generated 194 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:27.068037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:27.225889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bc71f56-d504-402d-a23c-ddf8e75af135 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:27.280668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff2d26b2-436d-44f4-9173-dbb7c4a284c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:27.281340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d26b2-436d-44f4-9173-dbb7c4a284c8 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:27.281642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d26b2-436d-44f4-9173-dbb7c4a284c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:27.281911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff2d26b2-436d-44f4-9173-dbb7c4a284c8 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:27.282651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d26b2-436d-44f4-9173-dbb7c4a284c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:27.284072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff2d26b2-436d-44f4-9173-dbb7c4a284c8 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:27.294295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 389/780] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:24:27 2022] GET /identity/v3/services => generated 772 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:27.711456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe8d4-328b-4474-8289-8eeb9e347735 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:27.711943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe8d4-328b-4474-8289-8eeb9e347735 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:27.711943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0fe8d4-328b-4474-8289-8eeb9e347735 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:27.713410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 392/781] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:27.719337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b0ba0-b2f1-47b1-a09a-58c3f348b42e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:27.719626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b0ba0-b2f1-47b1-a09a-58c3f348b42e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:27.719908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2b0ba0-b2f1-47b1-a09a-58c3f348b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:27.724980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:27.740634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6e2b0ba0-b2f1-47b1-a09a-58c3f348b42e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:27.741865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6e2b0ba0-b2f1-47b1-a09a-58c3f348b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:27.823877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 390/782] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:27 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:27.853056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fe8d4-328b-4474-8289-8eeb9e347735 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:27.891562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:27.987423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0fe8d4-328b-4474-8289-8eeb9e347735 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:28.033849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d87e-bc00-4351-adee-0fb45ba468a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:28.034994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d87e-bc00-4351-adee-0fb45ba468a5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.035468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d87e-bc00-4351-adee-0fb45ba468a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.035932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf7d87e-bc00-4351-adee-0fb45ba468a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.055123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf7d87e-bc00-4351-adee-0fb45ba468a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-5cf7d87e-bc00-4351-adee-0fb45ba468a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:28.063890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:28.064823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:28.065690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:28.068386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 393/783] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:28.074525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b0ba0-b2f1-47b1-a09a-58c3f348b42e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:28.228128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2b0ba0-b2f1-47b1-a09a-58c3f348b42e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:28.274563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:28.281540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5fd33d3-0c2f-4fb6-b6f0-e9b604142efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:28.282683 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd33d3-0c2f-4fb6-b6f0-e9b604142efa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.283174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd33d3-0c2f-4fb6-b6f0-e9b604142efa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.283780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fd33d3-0c2f-4fb6-b6f0-e9b604142efa None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.284549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd33d3-0c2f-4fb6-b6f0-e9b604142efa None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:28.284856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd33d3-0c2f-4fb6-b6f0-e9b604142efa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:28.286296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5fd33d3-0c2f-4fb6-b6f0-e9b604142efa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:28.301011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 391/784] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:28.306147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d87e-bc00-4351-adee-0fb45ba468a5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:28.417181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3596-aefe-415a-a402-bf8a5ed67f47 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.424485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3596-aefe-415a-a402-bf8a5ed67f47 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.425024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec1a3596-aefe-415a-a402-bf8a5ed67f47 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.426359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:28.428127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 392/785] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:28 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:28.434201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57eee1-47b7-4bc0-aea4-a3d13e39a32f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.434485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57eee1-47b7-4bc0-aea4-a3d13e39a32f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.435203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f57eee1-47b7-4bc0-aea4-a3d13e39a32f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.458106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf7d87e-bc00-4351-adee-0fb45ba468a5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:28.471580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4f57eee1-47b7-4bc0-aea4-a3d13e39a32f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:28.472774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4f57eee1-47b7-4bc0-aea4-a3d13e39a32f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:28.509214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c54306-3d8f-494f-9546-c0f41f76b469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:28.510037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54306-3d8f-494f-9546-c0f41f76b469 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.510313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54306-3d8f-494f-9546-c0f41f76b469 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.510583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c54306-3d8f-494f-9546-c0f41f76b469 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.530263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c54306-3d8f-494f-9546-c0f41f76b469 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:28.531643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c54306-3d8f-494f-9546-c0f41f76b469 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f9c54306-3d8f-494f-9546-c0f41f76b469 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:28.553748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:28.554676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:28.556226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:28.556226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:28.556226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:28.556226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:28.556226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 394/786] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:28.556539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec992-38a1-40b7-bf8b-cdd0a56dcb5c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.556765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec992-38a1-40b7-bf8b-cdd0a56dcb5c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.556972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faec992-38a1-40b7-bf8b-cdd0a56dcb5c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.558646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 395/787] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:28.565819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec992-38a1-40b7-bf8b-cdd0a56dcb5c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:28.579807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 393/788] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:28.581279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f1055-34f3-482e-9c9c-ebcf8974e8fa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.581845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f1055-34f3-482e-9c9c-ebcf8974e8fa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.582293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d81f1055-34f3-482e-9c9c-ebcf8974e8fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.598346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d81f1055-34f3-482e-9c9c-ebcf8974e8fa None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:28.599724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d81f1055-34f3-482e-9c9c-ebcf8974e8fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:28.675047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 394/789] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:28 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:28.676158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f1055-34f3-482e-9c9c-ebcf8974e8fa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:28.721436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faec992-38a1-40b7-bf8b-cdd0a56dcb5c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:28.748855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:28.770558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:28.771471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.771934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.772347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.773212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:28.773774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:28.775292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:28.783840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:28.794138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 396/790] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:28.795594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:28.805342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d81f1055-34f3-482e-9c9c-ebcf8974e8fa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:28.856397 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfacbce-a5a9-4846-84a0-9307c3b2b4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:28.857609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfacbce-a5a9-4846-84a0-9307c3b2b4c2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.857998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfacbce-a5a9-4846-84a0-9307c3b2b4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.858428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dfacbce-a5a9-4846-84a0-9307c3b2b4c2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.869492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dfacbce-a5a9-4846-84a0-9307c3b2b4c2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-0dfacbce-a5a9-4846-84a0-9307c3b2b4c2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:28.878148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:28.879264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:28.880112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:28.880747 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 395/791] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:28.881590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfacbce-a5a9-4846-84a0-9307c3b2b4c2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:28.920147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b25321-8558-45a8-aff4-bf684a816e80 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:28.957388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:28.958344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:28.958709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:28.959047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:28.959779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:28.961238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:28.976799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:28.978725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:28.980457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 397/792] 10.222.0.20 () {56 vars in 1129 bytes} [Tue Jul 12 08:24:28 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:28.982577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.018348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dfacbce-a5a9-4846-84a0-9307c3b2b4c2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.034294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:29.066107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:29.067556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.068867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.069156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.069453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.081566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.083639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:29.102550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:29.104392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 396/793] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:29.106668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.116427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce81964-c2f9-4f27-868f-e98623921bbd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.166756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.167440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.168003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.168285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.170249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:29.170566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.172789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.184722 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 398/794] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:29.185743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.215294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a18da95-cc75-4841-b0ea-fcf468fcd783 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.250792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.251565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.251915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.252256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.253038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:29.253405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.254874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.265355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 397/795] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:29.266366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.308274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:29.317011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3939f30c-e593-45cf-b46f-fdb5fcfde470 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.341558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:29.353365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.354067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.354346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.354616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.355461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:29.355767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.357807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.376463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 399/796] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:29.377279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.380906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f800905-e327-4813-bb08-dc092b3b4006 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.422756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a8a0ef-a5e8-4fe0-a0dc-1b89d3fea876 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.423557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a0ef-a5e8-4fe0-a0dc-1b89d3fea876 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.423836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a0ef-a5e8-4fe0-a0dc-1b89d3fea876 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.424111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8a0ef-a5e8-4fe0-a0dc-1b89d3fea876 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.436560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8a0ef-a5e8-4fe0-a0dc-1b89d3fea876 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.438234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a8a0ef-a5e8-4fe0-a0dc-1b89d3fea876 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-25a8a0ef-a5e8-4fe0-a0dc-1b89d3fea876 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:29.455804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:29.456760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 398/797] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f115-36ab-4a3a-b8b1-2c78b32f8dd7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f115-36ab-4a3a-b8b1-2c78b32f8dd7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94f115-36ab-4a3a-b8b1-2c78b32f8dd7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.462917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 399/798] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:29.463461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f115-36ab-4a3a-b8b1-2c78b32f8dd7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.491073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a5f66-6cc6-42a8-ad7b-8a5b2a57bfc5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.529234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.529885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.530160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.530427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.531131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:29.531434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.532790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.538000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 400/799] 10.222.0.20 () {56 vars in 1124 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:29.538853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.564908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:29.577360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94f115-36ab-4a3a-b8b1-2c78b32f8dd7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.587826 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:29.617918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab44c778-cf48-445e-be40-e378729127c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.619220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c778-cf48-445e-be40-e378729127c9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.619506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c778-cf48-445e-be40-e378729127c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.619783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab44c778-cf48-445e-be40-e378729127c9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.631971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44c778-cf48-445e-be40-e378729127c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.633408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab44c778-cf48-445e-be40-e378729127c9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.645715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff0713f1-56cf-4862-884e-9bacefbc3b17 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ab44c778-cf48-445e-be40-e378729127c9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:29.651403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:29.652293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:29.653176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:29.653176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:29.653176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:29.653176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:29.653176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 400/800] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:29.654335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632f59-ba8c-4b26-a335-9d814ac61f10 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.654594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632f59-ba8c-4b26-a335-9d814ac61f10 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.654871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba632f59-ba8c-4b26-a335-9d814ac61f10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.672189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ba632f59-ba8c-4b26-a335-9d814ac61f10 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:29.673374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba632f59-ba8c-4b26-a335-9d814ac61f10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:29.686229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.686891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.687168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.687441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.688156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:29.688458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.689880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.706768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 401/801] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:29.706768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.754092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 401/802] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:29 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:29.755011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632f59-ba8c-4b26-a335-9d814ac61f10 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.819449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7191e8e4-9bcd-4306-9945-9efc0d4239d5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.827275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:29.835649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:29.857582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a493-fbcd-4bff-a9e2-683ce8b1746c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.858232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a493-fbcd-4bff-a9e2-683ce8b1746c None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.858502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a493-fbcd-4bff-a9e2-683ce8b1746c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.858769 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3f3a493-fbcd-4bff-a9e2-683ce8b1746c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.859494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3a493-fbcd-4bff-a9e2-683ce8b1746c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.860837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3f3a493-fbcd-4bff-a9e2-683ce8b1746c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.867959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba632f59-ba8c-4b26-a335-9d814ac61f10 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:29.880884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 402/803] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:24:29 2022] POST /identity/v3/endpoints => generated 346 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:29.881794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a493-fbcd-4bff-a9e2-683ce8b1746c None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:29.927345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:29.928023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:29.928302 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:29.928575 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:29.929309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:29.929635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:29.931094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:29.949329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 402/804] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:29.949329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.002284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3f3a493-fbcd-4bff-a9e2-683ce8b1746c None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.045202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a233696-7ae6-47a0-bb74-31f6efe3dbab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.046199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233696-7ae6-47a0-bb74-31f6efe3dbab None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.046480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233696-7ae6-47a0-bb74-31f6efe3dbab None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.046754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a233696-7ae6-47a0-bb74-31f6efe3dbab None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.055439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a233696-7ae6-47a0-bb74-31f6efe3dbab None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.056893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a233696-7ae6-47a0-bb74-31f6efe3dbab None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.061523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e804a5-09a9-43bb-a909-45bbc2e6df39 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8a233696-7ae6-47a0-bb74-31f6efe3dbab None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:30.072195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:30.073114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:30.074115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 403/805] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:30.074695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f075eb-fedc-4ec7-9eb8-cb43777a09f2 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.074877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f075eb-fedc-4ec7-9eb8-cb43777a09f2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.075725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f075eb-fedc-4ec7-9eb8-cb43777a09f2 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.077125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 404/806] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:30.077840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f075eb-fedc-4ec7-9eb8-cb43777a09f2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.096067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:30.105549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ac00a-38d5-41a6-b858-a5fef7841254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.107107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ac00a-38d5-41a6-b858-a5fef7841254 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.107623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:30.108295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ac00a-38d5-41a6-b858-a5fef7841254 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.108634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc4ac00a-38d5-41a6-b858-a5fef7841254 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.120148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc4ac00a-38d5-41a6-b858-a5fef7841254 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-dc4ac00a-38d5-41a6-b858-a5fef7841254 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:30.127894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:30.129045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:30.130144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:30.131429 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 403/807] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:30.132061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ac00a-38d5-41a6-b858-a5fef7841254 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.194220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16f075eb-fedc-4ec7-9eb8-cb43777a09f2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.229301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7032e810-707d-4841-b582-473478b458d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.230176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032e810-707d-4841-b582-473478b458d1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.230429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032e810-707d-4841-b582-473478b458d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.230705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7032e810-707d-4841-b582-473478b458d1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.237808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032e810-707d-4841-b582-473478b458d1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.239245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7032e810-707d-4841-b582-473478b458d1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.240042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc4ac00a-38d5-41a6-b858-a5fef7841254 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7032e810-707d-4841-b582-473478b458d1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:30.253400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:30.254363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:30.255263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 405/808] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:30.256061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028379-d516-4eb8-9b42-6afcb0b0a263 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.256061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028379-d516-4eb8-9b42-6afcb0b0a263 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.256323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48028379-d516-4eb8-9b42-6afcb0b0a263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.273298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-48028379-d516-4eb8-9b42-6afcb0b0a263 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:30.274513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-48028379-d516-4eb8-9b42-6afcb0b0a263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:30.283884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.284843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.285330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.285822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.286780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:30.287080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.288568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.306299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 404/809] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:24:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:30.307200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.351042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 406/810] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:30 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:30.351877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48028379-d516-4eb8-9b42-6afcb0b0a263 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.366878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:30.370595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:30.432858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf578a74-f18d-4235-a6ea-884a319d4a28 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.470643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.471304 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.471587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.471856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.472595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:30.472894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.474241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48028379-d516-4eb8-9b42-6afcb0b0a263 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.474353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.482681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 405/811] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:30.483475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.516390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.517365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.517905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.518320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.519316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:30.519771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.521320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.534934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 407/812] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:30.535922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.588727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d693836-9b1b-43ba-9be6-8e7db7100fb7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.598787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:30.612076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:30.627867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b7d0-aa75-44c2-88e7-1558a2e241ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.628796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b7d0-aa75-44c2-88e7-1558a2e241ec None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.629076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b7d0-aa75-44c2-88e7-1558a2e241ec None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.629348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a700b7d0-aa75-44c2-88e7-1558a2e241ec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.643647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3866a54-fce0-4d69-b247-1bd9d122d9a4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.678744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.679533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.679813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.680086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] PATH_INFO: `/v3/services/network` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.680760 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.682134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:30.696599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:30.703589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:30.704669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 408/813] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:30 2022] GET /identity/v3/services/network => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:30.705664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.710679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700b7d0-aa75-44c2-88e7-1558a2e241ec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.712217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a700b7d0-aa75-44c2-88e7-1558a2e241ec None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.807392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b66eaf-15a2-47b4-bd57-fa014763f646 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.829696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 406/814] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:30 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:24:30.830509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b7d0-aa75-44c2-88e7-1558a2e241ec None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.843676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:30.848565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.849355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.849677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.849954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.852821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:30.863442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.864935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:30.883553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:30.884695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:30.891015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:30.891015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:30.891015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:30.891015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:30.891015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 409/815] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:30.891015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:30.946563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a700b7d0-aa75-44c2-88e7-1558a2e241ec None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:30.983382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24707ee8-a330-4958-b23e-4a01746d7bda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:30.984275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24707ee8-a330-4958-b23e-4a01746d7bda None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:30.984562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24707ee8-a330-4958-b23e-4a01746d7bda None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:30.984836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24707ee8-a330-4958-b23e-4a01746d7bda None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/5de7841acf434c53a3c17ee73fae76e0/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:30.986846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24707ee8-a330-4958-b23e-4a01746d7bda None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=5de7841acf434c53a3c17ee73fae76e0, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:30.988300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24707ee8-a330-4958-b23e-4a01746d7bda None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:30.998117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f248b71-ce87-4bd2-872d-09b8596ac2ce None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.001948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 407/816] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:30 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/5de7841acf434c53a3c17ee73fae76e0/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:24:31.002556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24707ee8-a330-4958-b23e-4a01746d7bda None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.049504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.050503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.050994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.051617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.053381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] RBAC: Adding query filter params (name=network) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:31.053906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.055494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.062402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 410/817] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:30 2022] GET /identity/v3/services?name=network => generated 124 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:31.063562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.097979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:31.143441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24707ee8-a330-4958-b23e-4a01746d7bda None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.147296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:31.186069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.186862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.187139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.187409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.198243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.199678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.212810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ee0f6c-7975-4bcf-a6d2-1a0eec942aed None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:31.219411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:31.220298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:31.221212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:31.221212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:31.221212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:31.221212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:31.221212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 408/818] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:31.222299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.255611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.256321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.256601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.256874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.257623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:31.257925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.259280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.272346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 411/819] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:31.273157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.349075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23770f82-ca5d-4bbb-85ab-3d9da986c873 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.371025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:31.386366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.387111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.387455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.388400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.389352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] RBAC: Adding query filter params (type=network) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:31.389789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.391223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.397294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 409/820] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/services?type=network => generated 350 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:31.399045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f30102-cd1e-41f3-9660-b6c86dd7c105 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.402813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.417972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:31.448229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.449370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.450756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.451181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.452049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:31.452500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.454022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.477479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 412/821] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:31.477479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.526477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b74dabd-3a6b-4a96-97f0-9be2fa304ae2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.564121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.565569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.566107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.567185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.577725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.580349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:31.600857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:31.601879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 410/822] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:31.608488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.612406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8681c2af-cabb-45e8-8a4c-585e876b0aa1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.648079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74752a-f186-4da8-92ee-92e42527c0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.648642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74752a-f186-4da8-92ee-92e42527c0c5 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.648919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74752a-f186-4da8-92ee-92e42527c0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.649187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b74752a-f186-4da8-92ee-92e42527c0c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.650006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74752a-f186-4da8-92ee-92e42527c0c5 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.651630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b74752a-f186-4da8-92ee-92e42527c0c5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.668318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:31.677789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 413/823] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:24:31 2022] POST /identity/v3/endpoints => generated 327 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:31.683528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74752a-f186-4da8-92ee-92e42527c0c5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.714990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:31.772320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddeb7204-e49c-47e9-8325-c0a6cc9f9112 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.833453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b74752a-f186-4da8-92ee-92e42527c0c5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:31.833691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.833691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.834143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.834428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.851054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.852550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:31.874111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:31.875087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:31.875970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 411/824] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:31.881682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:31.914122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:31.914750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:31.914991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:31.915265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:31.916119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:31.916422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:31.917891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:31.939817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 414/825] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:31.944831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.025748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:32.030757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fba663c-944a-4857-aef8-dcfc79c38bdd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.061592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:32.070907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b856e-6e07-43a6-aca7-37a1384912df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.071568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b856e-6e07-43a6-aca7-37a1384912df None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.071849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b856e-6e07-43a6-aca7-37a1384912df None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.072123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b856e-6e07-43a6-aca7-37a1384912df None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.072915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b856e-6e07-43a6-aca7-37a1384912df None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:32.073356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b856e-6e07-43a6-aca7-37a1384912df None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.074672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4b856e-6e07-43a6-aca7-37a1384912df None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.082534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08940739-dbcb-49fe-9887-96b05bd758d0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.093281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 412/826] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:32.093281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7189724-10a9-48e7-bb88-d001e6fb5c21 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.093281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7189724-10a9-48e7-bb88-d001e6fb5c21 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.093281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7189724-10a9-48e7-bb88-d001e6fb5c21 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.093281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 413/827] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:32.096770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7189724-10a9-48e7-bb88-d001e6fb5c21 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.123519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5379a-5e3b-4b15-8b71-33f6d0709e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.124365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5379a-5e3b-4b15-8b71-33f6d0709e4a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.124643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5379a-5e3b-4b15-8b71-33f6d0709e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.124964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5379a-5e3b-4b15-8b71-33f6d0709e4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.135501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5379a-5e3b-4b15-8b71-33f6d0709e4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.137121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5379a-5e3b-4b15-8b71-33f6d0709e4a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e8b5379a-5e3b-4b15-8b71-33f6d0709e4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:32.157324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:32.158429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:32.159321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:32.159321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:32.159321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:32.159321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:32.159321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 415/828] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:32.159724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e28f7c-7862-4287-ad4b-6c8c3e4e2ea5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.160006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e28f7c-7862-4287-ad4b-6c8c3e4e2ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.160303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e28f7c-7862-4287-ad4b-6c8c3e4e2ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.178377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-65e28f7c-7862-4287-ad4b-6c8c3e4e2ea5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:32.179481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-65e28f7c-7862-4287-ad4b-6c8c3e4e2ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:32.215094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7189724-10a9-48e7-bb88-d001e6fb5c21 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.250216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 416/829] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:32 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:32.251067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e28f7c-7862-4287-ad4b-6c8c3e4e2ea5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.265597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.266537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.267029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.267494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.268699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=1fe88851e1154cf0838e0cbe47459156) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:32.269253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.271074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.280392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 414/830] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:32 2022] GET /identity/v3/role_assignments?user.id=1fe88851e1154cf0838e0cbe47459156&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 608 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:32.281497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.311632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:32.343674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:32.395939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e28f7c-7862-4287-ad4b-6c8c3e4e2ea5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.421727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e871a380-3313-4cee-aa45-bab1162567fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.442238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.443208 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.443661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.444111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.445005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:32.445533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.447800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.467178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 417/831] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:32.468082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.473554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.474455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.474803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.475150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.475878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.477318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:32.493128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:32.494266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:32.500808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 415/832] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:32 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:32.503486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.582805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cdaa381-deb4-4ace-90f9-03c738bda9c0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.612448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:32.622791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:32.627640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.628436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.628714 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.628979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.638653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.640353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.641402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54078bc-cb88-4b88-89ea-bb45d49daf4e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:32.658397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:32.659350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:32.660261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:32.660261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:32.660261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:32.660261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:32.660261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:32.660261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:32.660261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:32.660261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:32.664702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 418/833] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:32.665566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.696107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.697618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.698419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.698906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.700015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:32.701101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.703133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.710381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 416/834] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:32 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:32.716857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.796069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c39db-e4e0-41bb-8379-1b85f208b795 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.833235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.833918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.834194 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.834464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.835240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:32.835544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.836966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.851557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 419/835] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:32.862864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:32.868400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312efb01-0a06-4c1d-aaaf-64b66a8095fe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:32.910662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce8afbb-207f-4fc6-a360-e91482e8e002 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:32.911726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8afbb-207f-4fc6-a360-e91482e8e002 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:32.912011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8afbb-207f-4fc6-a360-e91482e8e002 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:32.912289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce8afbb-207f-4fc6-a360-e91482e8e002 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:32.913353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8afbb-207f-4fc6-a360-e91482e8e002 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:32.913748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8afbb-207f-4fc6-a360-e91482e8e002 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:32.915716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce8afbb-207f-4fc6-a360-e91482e8e002 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:32.925518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 417/836] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:32 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:32.926048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:32.984457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0cb937e-2e60-4034-98f3-2105b1310ccd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:33.023783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0545f610-ca39-4ed8-b6e7-ef2f4c1b4483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:33.024810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f610-ca39-4ed8-b6e7-ef2f4c1b4483 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:33.025095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f610-ca39-4ed8-b6e7-ef2f4c1b4483 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:33.025370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0545f610-ca39-4ed8-b6e7-ef2f4c1b4483 None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/b46349b7039e4161ac7f9ac2e477a9d9/roles/48eb4b7efc744ce28a9b3dd160821614` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:33.042653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545f610-ca39-4ed8-b6e7-ef2f4c1b4483 None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=b46349b7039e4161ac7f9ac2e477a9d9, role_id=48eb4b7efc744ce28a9b3dd160821614)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:33.044819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0545f610-ca39-4ed8-b6e7-ef2f4c1b4483 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:33.063348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 420/837] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:32 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/b46349b7039e4161ac7f9ac2e477a9d9/roles/48eb4b7efc744ce28a9b3dd160821614 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:24:33.200331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a430f-a8f3-4f29-b9d0-aefd23635a27 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:33.200860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a430f-a8f3-4f29-b9d0-aefd23635a27 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:33.201309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2a430f-a8f3-4f29-b9d0-aefd23635a27 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:33.203082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 418/838] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:33.208431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40476fbd-e1f7-482a-97bb-4445f3047ff3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:33.208849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40476fbd-e1f7-482a-97bb-4445f3047ff3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:33.209245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40476fbd-e1f7-482a-97bb-4445f3047ff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:33.227890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-40476fbd-e1f7-482a-97bb-4445f3047ff3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:33.229325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-40476fbd-e1f7-482a-97bb-4445f3047ff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:33.304879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 421/839] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:33 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:33.328612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a430f-a8f3-4f29-b9d0-aefd23635a27 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:33.348527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:33.443149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2a430f-a8f3-4f29-b9d0-aefd23635a27 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:33.478374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3683d-5f78-46c9-9b57-dfaccf526f99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:33.479168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3683d-5f78-46c9-9b57-dfaccf526f99 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:33.479451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3683d-5f78-46c9-9b57-dfaccf526f99 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:33.479726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3683d-5f78-46c9-9b57-dfaccf526f99 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:33.490807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4aa3683d-5f78-46c9-9b57-dfaccf526f99 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4aa3683d-5f78-46c9-9b57-dfaccf526f99 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:33.498439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:33.499396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:33.500227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 419/840] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:33.505913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40476fbd-e1f7-482a-97bb-4445f3047ff3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:33.535635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:33.624936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40476fbd-e1f7-482a-97bb-4445f3047ff3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:33.663054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:33.663727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:33.664005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:33.664275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:33.665024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:33.665331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:33.666730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:33.676962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 422/841] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:33.682508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3683d-5f78-46c9-9b57-dfaccf526f99 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:33.763552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:33.787426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3683d-5f78-46c9-9b57-dfaccf526f99 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:33.938424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:33.939136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:33.939422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:33.939684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:33.950153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:33.951824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:33.969877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:33.970895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:33.971803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:33.971803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:33.971803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:33.971803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:33.971803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 420/842] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:33.976989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:34.067440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:34.084800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2616e00-8db1-44fc-ac66-0037bb62e018 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:34.122748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:34.123478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:34.123648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:34.123900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:34.124618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:34.124918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:34.126303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:34.144088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 423/843] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:34.149715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:34.253443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4904c13-5144-4573-860a-1bdb6bed776a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:34.282080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:34.290230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9dd1402-903d-4380-8fc1-5e3c6bb320d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:34.291028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1402-903d-4380-8fc1-5e3c6bb320d1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:34.291309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1402-903d-4380-8fc1-5e3c6bb320d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:34.291616 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9dd1402-903d-4380-8fc1-5e3c6bb320d1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:34.300742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd1402-903d-4380-8fc1-5e3c6bb320d1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:34.302222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9dd1402-903d-4380-8fc1-5e3c6bb320d1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d9dd1402-903d-4380-8fc1-5e3c6bb320d1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:34.317266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:34.318242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:34.319172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 421/844] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:24:34 2022] GET /identity/v3/users/swift => generated 83 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:34.324375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:34.442719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5972094-87f8-463a-a418-aa3e87cfa624 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:34.478826 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:34.479843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:34.480346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:34.480813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:34.482016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:34.482521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:34.484177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:34.486638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4003f6e-7d13-4f8a-86bf-c4b26ae4e5bf None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:34.487098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4003f6e-7d13-4f8a-86bf-c4b26ae4e5bf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:34.487281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4003f6e-7d13-4f8a-86bf-c4b26ae4e5bf None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:34.488803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 422/845] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:34.493644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5760d-e2e2-46a2-bedd-9ef3411b85ef None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:34.493955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5760d-e2e2-46a2-bedd-9ef3411b85ef None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:34.494194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e5760d-e2e2-46a2-bedd-9ef3411b85ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:34.504684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 424/846] 10.222.0.20 () {56 vars in 1135 bytes} [Tue Jul 12 08:24:34 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:34.510374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:34.514580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:34.517107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f5e5760d-e2e2-46a2-bedd-9ef3411b85ef None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:34.518686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5e5760d-e2e2-46a2-bedd-9ef3411b85ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:34.610012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 423/847] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:34 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:34.624903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd9e49d-af42-423b-ae8e-1345c6235e4a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:34.632479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5760d-e2e2-46a2-bedd-9ef3411b85ef None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:34.663226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa909b-83b3-4cbb-8e70-225d3558a53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:34.663871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa909b-83b3-4cbb-8e70-225d3558a53a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:34.664146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa909b-83b3-4cbb-8e70-225d3558a53a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:34.664416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4aa909b-83b3-4cbb-8e70-225d3558a53a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:34.739823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa909b-83b3-4cbb-8e70-225d3558a53a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:34.741524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4aa909b-83b3-4cbb-8e70-225d3558a53a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:34.744944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:34.763214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e5760d-e2e2-46a2-bedd-9ef3411b85ef None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:34.783865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:34.801091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:34.801924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:34.802199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:34.802465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:34.803118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:34.804587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:34.818619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:34.819592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:34.820425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:34.824457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 424/848] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 12 08:24:34 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:34.825337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:34.873536 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 425/849] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:34 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 358 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:24:34.876001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa909b-83b3-4cbb-8e70-225d3558a53a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:34.929522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1341f0a-ee00-4007-af71-e47d7cadd38d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:34.964215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:34.964880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:34.965154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:34.965505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:34.966898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:34.967206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:34.968574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:34.973673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 425/850] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:34 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:34.978711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:35.004575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4aa909b-83b3-4cbb-8e70-225d3558a53a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:35.009817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:35.038985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:35.042440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b472d4-41c6-4ed5-bbbc-305fe28a0af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:35.043366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b472d4-41c6-4ed5-bbbc-305fe28a0af2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.043694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b472d4-41c6-4ed5-bbbc-305fe28a0af2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.044613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b472d4-41c6-4ed5-bbbc-305fe28a0af2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.059321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b472d4-41c6-4ed5-bbbc-305fe28a0af2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:35.061186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b472d4-41c6-4ed5-bbbc-305fe28a0af2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e8b472d4-41c6-4ed5-bbbc-305fe28a0af2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:35.079757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:35.080703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:35.081639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:35.081639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:35.081639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:35.081639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:35.083575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 426/851] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:35.084818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b641e11-28db-4ad7-a7f6-b263d11ea566 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.085100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b641e11-28db-4ad7-a7f6-b263d11ea566 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.085372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b641e11-28db-4ad7-a7f6-b263d11ea566 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.086791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 427/852] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:35.090238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b641e11-28db-4ad7-a7f6-b263d11ea566 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:35.104197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35bb7dba-a113-420f-ba4f-cf8794569ba4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:35.141321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79f083e3-d671-49f6-af55-fd1615692dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:35.142055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f083e3-d671-49f6-af55-fd1615692dfe None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.142337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f083e3-d671-49f6-af55-fd1615692dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.142614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79f083e3-d671-49f6-af55-fd1615692dfe None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.143320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f083e3-d671-49f6-af55-fd1615692dfe None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:35.143622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f083e3-d671-49f6-af55-fd1615692dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:35.144990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79f083e3-d671-49f6-af55-fd1615692dfe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:35.153881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 426/853] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:34 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:35.153881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080677-9d64-4e8c-90d3-e1bd90167899 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.153881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080677-9d64-4e8c-90d3-e1bd90167899 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.153881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21080677-9d64-4e8c-90d3-e1bd90167899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.178922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-21080677-9d64-4e8c-90d3-e1bd90167899 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:35.180164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-21080677-9d64-4e8c-90d3-e1bd90167899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:35.227144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b641e11-28db-4ad7-a7f6-b263d11ea566 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:35.266773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 427/854] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:35 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:35.275677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:35.275677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.275677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.275677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.276102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:35.276102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:35.276102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:35.288366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 428/855] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:35.289725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21080677-9d64-4e8c-90d3-e1bd90167899 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:35.297640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:35.324133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:35.343651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:35.421323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21080677-9d64-4e8c-90d3-e1bd90167899 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:35.429003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dee5fa1-5fa0-4e7e-ab2c-91c118f367e3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:35.461313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49d0fb43-f1bc-477b-adee-1c76f1d870b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:35.461955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0fb43-f1bc-477b-adee-1c76f1d870b6 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.462238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0fb43-f1bc-477b-adee-1c76f1d870b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.462514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49d0fb43-f1bc-477b-adee-1c76f1d870b6 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.463278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0fb43-f1bc-477b-adee-1c76f1d870b6 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:35.464601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:35.464719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49d0fb43-f1bc-477b-adee-1c76f1d870b6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:35.465385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.465796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.466165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.473843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:35.475293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:35.483837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 428/856] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:24:35 2022] POST /identity/v3/services => generated 251 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:35.485165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c195f-3f6f-4b86-bab1-63c9f6cbfebe None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.485474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c195f-3f6f-4b86-bab1-63c9f6cbfebe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.485762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e6c195f-3f6f-4b86-bab1-63c9f6cbfebe None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.487268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 429/857] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:35.492234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:35.493376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:35.494336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:35.494336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:35.494336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:35.494336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:35.494336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:35.494336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:35.494336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:35.494336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:35.501609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d532df-59d7-4d4d-878f-12ae3373d98d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.501609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d532df-59d7-4d4d-878f-12ae3373d98d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.501609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00d532df-59d7-4d4d-878f-12ae3373d98d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.501975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 429/858] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:35.503804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:35.527265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-00d532df-59d7-4d4d-878f-12ae3373d98d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:35.529329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-00d532df-59d7-4d4d-878f-12ae3373d98d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:35.600710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:35.630935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2e2964e-c436-4ee3-9c8b-e1d4e54c2199 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:35.644321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 430/859] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:35 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:35.668284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d532df-59d7-4d4d-878f-12ae3373d98d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:35.674510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:35.675172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.675454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.675725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.676513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:35.676818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:35.678286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:35.691429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 430/860] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:35.697194 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:35.699527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:35.788425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00d532df-59d7-4d4d-878f-12ae3373d98d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:35.826935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d8d62-1bfd-4462-a2e6-44871a065239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:35.828207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d8d62-1bfd-4462-a2e6-44871a065239 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.828692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d8d62-1bfd-4462-a2e6-44871a065239 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.829167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90d8d62-1bfd-4462-a2e6-44871a065239 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.838968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc86f9af-5f92-42f3-91cd-c7f743237c46 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:35.840369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90d8d62-1bfd-4462-a2e6-44871a065239 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b90d8d62-1bfd-4462-a2e6-44871a065239 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:35.848625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:35.849606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:24:35.850470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:35.853214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 431/861] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:24:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:35.860069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d8d62-1bfd-4462-a2e6-44871a065239 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:35.877035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:35.877779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:35.878085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:35.879012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:35.879865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=5de7841acf434c53a3c17ee73fae76e0) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:35.880177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:35.882074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:35.886357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:35.893504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 431/862] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:35 2022] GET /identity/v3/role_assignments?user.id=5de7841acf434c53a3c17ee73fae76e0&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 608 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:35.977332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:35.995247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90d8d62-1bfd-4462-a2e6-44871a065239 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:36.034972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:36.036025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:36.036515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:36.036995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:36.038056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:36.038577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:36.040190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:36.051484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 432/863] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:24:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:36.057456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:36.170977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-957ac073-bb22-4960-8a21-2f27132db0dd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:36.206229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:36.207531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:36.208018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:36.208542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:36.220504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:36.222261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:36.240059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:36.240997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:36.242028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:36.242028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:36.242028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:36.242028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:36.244371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 432/864] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:36.250744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:36.368495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06967653-59df-49fe-bf48-942ed16e3a1a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:36.402382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:36.403540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:36.403866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:36.404135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:36.404854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:36.405212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:36.406670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:36.419420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 433/865] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:36.424928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:36.485641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:36.536011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c68fe2e-d2b1-40ae-b059-d32491dd809d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:36.570796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:36.571690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:36.571978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:36.572255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:36.580441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:36.581915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:36.596584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:36.597559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:36.599183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 433/866] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:24:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:36.603657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:36.616684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:36.716602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98caf291-800a-4833-a528-c8d4ea58eddf None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:36.753050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:36.753754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:36.754034 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:36.754308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:36.755149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:36.755455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:36.756884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:36.776045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 434/867] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 12 08:24:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:36.781472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:36.885150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e386537-8bcd-451f-93a5-b258e3ddd2dd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:36.909780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:36.922150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a17ced-6c5d-4123-821a-cdf5b2c399da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:36.922801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a17ced-6c5d-4123-821a-cdf5b2c399da None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:36.923083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a17ced-6c5d-4123-821a-cdf5b2c399da None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:36.923361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a17ced-6c5d-4123-821a-cdf5b2c399da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:36.992975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a17ced-6c5d-4123-821a-cdf5b2c399da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:36.994385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a17ced-6c5d-4123-821a-cdf5b2c399da None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:37.103255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 434/868] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:36 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:24:37.110516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:37.180953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:37.218556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd41677a-b1de-4b7a-b036-ce0d140de7ba None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:37.242573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a2b7a-4e06-4114-ad12-8500215499ca None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.242885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a2b7a-4e06-4114-ad12-8500215499ca None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.243192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e94a2b7a-4e06-4114-ad12-8500215499ca None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.244783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 435/869] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:37.249667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047e3d-0638-4d63-a78d-6041823c57c1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.249954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047e3d-0638-4d63-a78d-6041823c57c1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.250234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da047e3d-0638-4d63-a78d-6041823c57c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.254195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:37.254982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.255259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.255529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.266447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:37.267895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:37.269045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-da047e3d-0638-4d63-a78d-6041823c57c1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:37.270529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-da047e3d-0638-4d63-a78d-6041823c57c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:37.285752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:37.285929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:37.286758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:37.287839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:37.287839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:37.287839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:37.287839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:37.287839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 435/870] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:37.294931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:37.348773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 436/871] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:37 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:37.373293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da047e3d-0638-4d63-a78d-6041823c57c1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:37.421454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1574bd50-e9cb-463d-ad85-58b821bdc667 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:37.444795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:37.470897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:37.471841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.472511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.472867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.473953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:37.474510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:37.476637 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:37.480805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da047e3d-0638-4d63-a78d-6041823c57c1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:37.493583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 436/872] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:37.498337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:37.526665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ecae8-f79c-4be3-8e55-c6c697982819 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:37.527733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ecae8-f79c-4be3-8e55-c6c697982819 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.528281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ecae8-f79c-4be3-8e55-c6c697982819 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.528687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-313ecae8-f79c-4be3-8e55-c6c697982819 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.529453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ecae8-f79c-4be3-8e55-c6c697982819 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:37.531491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-313ecae8-f79c-4be3-8e55-c6c697982819 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:37.550997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 437/873] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:24:37 2022] POST /identity/v3/services => generated 269 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:37.617021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e477f4-f2b0-40b5-ae85-30c536ebc372 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:37.663738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ec7ab-4250-4c39-af55-355304e3a643 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:37.664545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ec7ab-4250-4c39-af55-355304e3a643 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.664828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ec7ab-4250-4c39-af55-355304e3a643 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.665100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ec7ab-4250-4c39-af55-355304e3a643 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.673484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ec7ab-4250-4c39-af55-355304e3a643 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:37.674971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ec7ab-4250-4c39-af55-355304e3a643 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2d7ec7ab-4250-4c39-af55-355304e3a643 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:37.691580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:37.692549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:37.693658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 437/874] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:37.699012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ecae8-f79c-4be3-8e55-c6c697982819 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:37.709198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:37.710766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1098-9b1a-4cc6-ae9c-ee1a6babce44 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.711076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1098-9b1a-4cc6-ae9c-ee1a6babce44 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.711334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84c1098-9b1a-4cc6-ae9c-ee1a6babce44 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.717609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 438/875] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:37 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:37.718867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd306e7-a3ac-43ea-8115-ae7034ff4844 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.719150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd306e7-a3ac-43ea-8115-ae7034ff4844 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.719421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd306e7-a3ac-43ea-8115-ae7034ff4844 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.739590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9cd306e7-a3ac-43ea-8115-ae7034ff4844 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:37.740310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9cd306e7-a3ac-43ea-8115-ae7034ff4844 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:37.776564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:37.826058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-313ecae8-f79c-4be3-8e55-c6c697982819 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:37.839153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 439/876] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:37 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:37.862951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd306e7-a3ac-43ea-8115-ae7034ff4844 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:37.865935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:37.867225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:37.867918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:37.868594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:37.869941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:37.870434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:37.872655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:37.886137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 438/877] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:37.892711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:37.961799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:37.967348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd306e7-a3ac-43ea-8115-ae7034ff4844 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:37.998025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb6f655-e7ce-4860-8884-d2ba209ddcf0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:38.002584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.003381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.003658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.003934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.004585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.005984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:38.018514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:38.019559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:38.020401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:38.024635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 440/878] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:37 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:38.025853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:38.041882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5b33e0-2b4f-4683-8ba5-6a1a90583123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.042875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b33e0-2b4f-4683-8ba5-6a1a90583123 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.043362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b33e0-2b4f-4683-8ba5-6a1a90583123 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.044573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5b33e0-2b4f-4683-8ba5-6a1a90583123 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.045728 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b33e0-2b4f-4683-8ba5-6a1a90583123 None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=b46349b7039e4161ac7f9ac2e477a9d9) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:38.046248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b33e0-2b4f-4683-8ba5-6a1a90583123 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.047936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5b33e0-2b4f-4683-8ba5-6a1a90583123 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.055959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:38.061660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 439/879] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:37 2022] GET /identity/v3/role_assignments?user.id=b46349b7039e4161ac7f9ac2e477a9d9&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:38.146338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ed9c3e-f348-46bc-84a9-64c2eac8be8c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:38.185632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087dde55-724c-4b4d-b347-1cd80d0f7f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.186554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dde55-724c-4b4d-b347-1cd80d0f7f31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.186974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dde55-724c-4b4d-b347-1cd80d0f7f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.187495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087dde55-724c-4b4d-b347-1cd80d0f7f31 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.188223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dde55-724c-4b4d-b347-1cd80d0f7f31 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:38.188525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dde55-724c-4b4d-b347-1cd80d0f7f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.189778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e6eb-0f99-40cb-a3ac-a5b512282ac2 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.190262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087dde55-724c-4b4d-b347-1cd80d0f7f31 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.190778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e6eb-0f99-40cb-a3ac-a5b512282ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.191260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab9e6eb-0f99-40cb-a3ac-a5b512282ac2 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.195700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 441/881] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:38 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:38.196000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 440/881] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:38.203120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaa95-e73b-4c2b-a0b7-c506d0d7e0dd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.203470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaa95-e73b-4c2b-a0b7-c506d0d7e0dd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.203675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cabaa95-e73b-4c2b-a0b7-c506d0d7e0dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.204094 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9e6eb-0f99-40cb-a3ac-a5b512282ac2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:38.221301 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2cabaa95-e73b-4c2b-a0b7-c506d0d7e0dd None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:38.222519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2cabaa95-e73b-4c2b-a0b7-c506d0d7e0dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:38.308829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 442/882] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:38 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:38.336147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabaa95-e73b-4c2b-a0b7-c506d0d7e0dd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:38.348681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bab9e6eb-0f99-40cb-a3ac-a5b512282ac2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:38.366756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:38.383720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:38.394947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.395944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.396429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.396896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.397849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:38.398413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.400008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.408428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 441/883] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:38 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:38.425476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:38.462708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cabaa95-e73b-4c2b-a0b7-c506d0d7e0dd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:38.508509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.509320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.509661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.509932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.510583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.511925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:38.527840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:38.529618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:38.530468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 443/884] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:38 2022] GET /identity/v3/services/object-store => generated 93 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:38.535639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:38.549757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d1b98-34db-4534-9fdf-4cecd5d1ae8b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:38.588695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.589404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.589812 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.590179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.591795 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] RBAC: Adding query filter params (interface=public, service_id=1abea7f24d13488383a4fe4e4eee36f6, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:38.592209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.593701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.603889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 442/885] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 12 08:24:38 2022] GET /identity/v3/endpoints?service_id=1abea7f24d13488383a4fe4e4eee36f6&interface=public®ion_id=RegionOne => generated 194 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:38.605257 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:38.651986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:38.674201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:38.677114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd22fe53-f52b-414b-9342-d8bd3d310adc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:38.725686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.726487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.726877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.727244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.728039 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:38.728438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.729949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.730363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870093a-b810-4d72-92aa-f3be8d186bb5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:38.740085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 444/886] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:38 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:38.741507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:38.774758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed15331a-1f66-4054-a43d-7c516b429700 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.775880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15331a-1f66-4054-a43d-7c516b429700 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.776450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15331a-1f66-4054-a43d-7c516b429700 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.776820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed15331a-1f66-4054-a43d-7c516b429700 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.778782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15331a-1f66-4054-a43d-7c516b429700 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.780680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed15331a-1f66-4054-a43d-7c516b429700 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.789458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 443/887] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:24:38 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:24:38.870607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0673fc3d-3d4c-495b-9295-f372ab6d55ef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:38.909734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f536df-1309-4095-a91f-abb8ebc51ab6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:38.910412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f536df-1309-4095-a91f-abb8ebc51ab6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:38.910694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f536df-1309-4095-a91f-abb8ebc51ab6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:38.911029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f536df-1309-4095-a91f-abb8ebc51ab6 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:38.911755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f536df-1309-4095-a91f-abb8ebc51ab6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:38.912106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f536df-1309-4095-a91f-abb8ebc51ab6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:38.913527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f536df-1309-4095-a91f-abb8ebc51ab6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:38.925540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 445/888] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:38 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:39.725293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2873da-fe6a-4b54-8178-11ce7613cdb1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:39.725810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2873da-fe6a-4b54-8178-11ce7613cdb1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:39.725810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2873da-fe6a-4b54-8178-11ce7613cdb1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:39.727449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 444/889] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:39.733159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212740a4-79a4-4185-8bcd-e8888b1a8c73 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:39.733617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212740a4-79a4-4185-8bcd-e8888b1a8c73 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:39.733800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-212740a4-79a4-4185-8bcd-e8888b1a8c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:39.750813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-212740a4-79a4-4185-8bcd-e8888b1a8c73 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:39.751999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-212740a4-79a4-4185-8bcd-e8888b1a8c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:39.761811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:39.821713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 446/890] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:39 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:39.844772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2873da-fe6a-4b54-8178-11ce7613cdb1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:39.956736 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2873da-fe6a-4b54-8178-11ce7613cdb1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:39.981893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:39.992923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:39.993837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:39.994269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:39.994803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:39.995456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:39.997380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:40.009970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:40.010921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:40.011761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 445/891] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 12 08:24:39 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:40.017216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212740a4-79a4-4185-8bcd-e8888b1a8c73 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:40.125091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-212740a4-79a4-4185-8bcd-e8888b1a8c73 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:40.161576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:40.162515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.162980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.163435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.164341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:40.164826 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:40.166380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:40.172608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 447/892] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:40 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:40.178345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:40.286714 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f556b0c-84b4-46fe-80a0-685f4bf787be None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:40.321197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029a0e0-21fc-45f0-91e6-1aa1caed3b46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:40.321885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a0e0-21fc-45f0-91e6-1aa1caed3b46 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.322161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a0e0-21fc-45f0-91e6-1aa1caed3b46 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.322432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029a0e0-21fc-45f0-91e6-1aa1caed3b46 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.323136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a0e0-21fc-45f0-91e6-1aa1caed3b46 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:40.323440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a0e0-21fc-45f0-91e6-1aa1caed3b46 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:40.325291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029a0e0-21fc-45f0-91e6-1aa1caed3b46 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:40.330665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 446/893] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:40 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:40.336352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:40.338713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc4f6-c528-4c34-b4f2-28163947ea74 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.339004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc4f6-c528-4c34-b4f2-28163947ea74 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.339278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52adc4f6-c528-4c34-b4f2-28163947ea74 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.341450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 447/894] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:40.346314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0bd8-18a3-44fc-b891-b6eb3b929061 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.346600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0bd8-18a3-44fc-b891-b6eb3b929061 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.346896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6b0bd8-18a3-44fc-b891-b6eb3b929061 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.350365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:40.365852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4e6b0bd8-18a3-44fc-b891-b6eb3b929061 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:40.367183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4e6b0bd8-18a3-44fc-b891-b6eb3b929061 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:40.421355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:40.466911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 448/895] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:40.470406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c3c4d6-893e-42b9-ada5-7756f590cbc4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:40.494234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b0bd8-18a3-44fc-b891-b6eb3b929061 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:40.510504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:40.511423 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.512003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.513074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.514774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] RBAC: Adding query filter params (interface=public, service_id=db46078920df40008e313ec1c84e16bc, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:40.515245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:40.517240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:40.523946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 448/896] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 12 08:24:40 2022] GET /identity/v3/endpoints?service_id=db46078920df40008e313ec1c84e16bc&interface=public®ion_id=RegionOne => generated 194 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:40.530596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:40.617578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6b0bd8-18a3-44fc-b891-b6eb3b929061 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:40.627285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:40.664788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde55c11-73ef-4ce2-a7b7-a12a0c9610b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:40.665686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55c11-73ef-4ce2-a7b7-a12a0c9610b8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.665914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55c11-73ef-4ce2-a7b7-a12a0c9610b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.666188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde55c11-73ef-4ce2-a7b7-a12a0c9610b8 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.673091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6565c63a-7744-4bf1-9f5b-8cf88ea63469 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:40.677993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde55c11-73ef-4ce2-a7b7-a12a0c9610b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-cde55c11-73ef-4ce2-a7b7-a12a0c9610b8 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:40.687023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:40.688001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:24:40.688841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:40.693222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 449/897] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 12 08:24:40 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:40.694105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde55c11-73ef-4ce2-a7b7-a12a0c9610b8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:40.721862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd836c9f-ff51-42cc-8e35-f32f60f42423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:40.723112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd836c9f-ff51-42cc-8e35-f32f60f42423 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.723855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd836c9f-ff51-42cc-8e35-f32f60f42423 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.724308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd836c9f-ff51-42cc-8e35-f32f60f42423 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.725905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd836c9f-ff51-42cc-8e35-f32f60f42423 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:40.728124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd836c9f-ff51-42cc-8e35-f32f60f42423 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:40.732703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:40.742687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 449/898] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:24:40 2022] GET /identity/v3/services => generated 1268 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:24:40.809992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde55c11-73ef-4ce2-a7b7-a12a0c9610b8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:40.848773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68e108b-5a78-4820-a3ca-ee3d8fe2922a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:40.849816 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e108b-5a78-4820-a3ca-ee3d8fe2922a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.850311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e108b-5a78-4820-a3ca-ee3d8fe2922a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.850771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68e108b-5a78-4820-a3ca-ee3d8fe2922a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.851706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e108b-5a78-4820-a3ca-ee3d8fe2922a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:40.852191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e108b-5a78-4820-a3ca-ee3d8fe2922a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:40.853800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68e108b-5a78-4820-a3ca-ee3d8fe2922a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:40.864135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 450/899] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 12 08:24:40 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:40.870702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd836c9f-ff51-42cc-8e35-f32f60f42423 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:40.900116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1f51-561f-4520-8ff5-4b41bd595506 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.900702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1f51-561f-4520-8ff5-4b41bd595506 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.900939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6a1f51-561f-4520-8ff5-4b41bd595506 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.902625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 451/900] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:40.908004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5617-47ed-403d-bceb-eb76619b798a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:40.908293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5617-47ed-403d-bceb-eb76619b798a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:40.908571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aae5617-47ed-403d-bceb-eb76619b798a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:40.928013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9aae5617-47ed-403d-bceb-eb76619b798a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:40.929205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9aae5617-47ed-403d-bceb-eb76619b798a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:40.992727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd836c9f-ff51-42cc-8e35-f32f60f42423 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.004265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 452/901] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:40 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:41.028102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae5617-47ed-403d-bceb-eb76619b798a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.034254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f5be870-73f0-42a8-9cfd-4f34e375404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.035902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5be870-73f0-42a8-9cfd-4f34e375404a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.036181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5be870-73f0-42a8-9cfd-4f34e375404a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.036448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f5be870-73f0-42a8-9cfd-4f34e375404a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.046788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:41.049094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5be870-73f0-42a8-9cfd-4f34e375404a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.050594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f5be870-73f0-42a8-9cfd-4f34e375404a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.063868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1f5be870-73f0-42a8-9cfd-4f34e375404a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:41.069437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:41.070306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:41.071187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:41.071187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:41.071187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:41.071187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:41.077460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 450/902] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:41.077460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe25b3e-4633-4ca0-a995-f32f52751a32 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.077460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe25b3e-4633-4ca0-a995-f32f52751a32 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.077460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fe25b3e-4633-4ca0-a995-f32f52751a32 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.077460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 451/903] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:41.078495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe25b3e-4633-4ca0-a995-f32f52751a32 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.154346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aae5617-47ed-403d-bceb-eb76619b798a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.189506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7081aa1b-c5ca-40d1-9193-eab6c5c7c261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.190300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081aa1b-c5ca-40d1-9193-eab6c5c7c261 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.190577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081aa1b-c5ca-40d1-9193-eab6c5c7c261 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.190847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7081aa1b-c5ca-40d1-9193-eab6c5c7c261 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.191499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081aa1b-c5ca-40d1-9193-eab6c5c7c261 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.192913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7081aa1b-c5ca-40d1-9193-eab6c5c7c261 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.199663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fe25b3e-4633-4ca0-a995-f32f52751a32 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-7081aa1b-c5ca-40d1-9193-eab6c5c7c261 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:41.205701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:41.206702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 12 08:24:41.207544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:41.211887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 453/904] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:41 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:41.212927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47f704-b663-45c5-867b-9f0ba84fe4f4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.213207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47f704-b663-45c5-867b-9f0ba84fe4f4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.213502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f47f704-b663-45c5-867b-9f0ba84fe4f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.230962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9f47f704-b663-45c5-867b-9f0ba84fe4f4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:41.232185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f47f704-b663-45c5-867b-9f0ba84fe4f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:41.238113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.238775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.239050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.239319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.240031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:41.240331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.241834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.257511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 452/905] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:41.257511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.304992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 454/906] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:41 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:41.310195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47f704-b663-45c5-867b-9f0ba84fe4f4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.321188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:41.338299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:41.378081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49ff3e02-afd8-4237-ba9e-b9e60e6dedf3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.414664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.415577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.415946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.416667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.417212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:41.417609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.419357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.429661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 453/907] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:41 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:41.429661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.435536 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f47f704-b663-45c5-867b-9f0ba84fe4f4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.473794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.474668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.474949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.475277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.482661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.484100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:41.499631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:41.500605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:41.501555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 455/908] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:24:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:41.502166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.538605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573eb82a-f190-48d4-9cae-ee36762314d1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.553621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:41.576718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab87b4e-2e64-4af5-b459-7cc965265058 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.577375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87b4e-2e64-4af5-b459-7cc965265058 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.577687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87b4e-2e64-4af5-b459-7cc965265058 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.577956 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab87b4e-2e64-4af5-b459-7cc965265058 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.578672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab87b4e-2e64-4af5-b459-7cc965265058 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.580020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab87b4e-2e64-4af5-b459-7cc965265058 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.597524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 454/909] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:24:41 2022] POST /identity/v3/services => generated 241 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:41.597524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab87b4e-2e64-4af5-b459-7cc965265058 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.607470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:41.634297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9ace8f5-3c08-4cc3-a643-b3c26c7be477 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.684927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.686776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.687210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.687666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.688535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:41.688991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.690860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.698402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 456/910] 10.222.0.20 () {56 vars in 1114 bytes} [Tue Jul 12 08:24:41 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:41.704840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.742053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab87b4e-2e64-4af5-b459-7cc965265058 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.781863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.783330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.783607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.783890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.784740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:41.785038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.786521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.807916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 455/911] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 12 08:24:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:41.813213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:41.836640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d4ea416-fdd5-4b87-a16c-ec0e910ddd07 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.851923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:41.882812 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec02bf-4a3c-4858-a93c-fe79840719e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.884136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec02bf-4a3c-4858-a93c-fe79840719e2 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.884830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec02bf-4a3c-4858-a93c-fe79840719e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.885252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ec02bf-4a3c-4858-a93c-fe79840719e2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:41.886416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec02bf-4a3c-4858-a93c-fe79840719e2 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:41.889865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ec02bf-4a3c-4858-a93c-fe79840719e2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:41.908521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:41.920683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 457/912] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:24:41 2022] POST /identity/v3/endpoints => generated 346 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:41.939166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a37bb9-4ac5-4991-831d-6d29c0740d8e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:41.987013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4f15f-8559-4f60-b73b-485fbfb824c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:41.988079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f15f-8559-4f60-b73b-485fbfb824c2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:41.988681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f15f-8559-4f60-b73b-485fbfb824c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:41.989250 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e4f15f-8559-4f60-b73b-485fbfb824c2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:42.066939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4f15f-8559-4f60-b73b-485fbfb824c2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:42.068800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e4f15f-8559-4f60-b73b-485fbfb824c2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:42.098641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:42.177585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 456/913] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:41 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 08:24:42.183196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec02bf-4a3c-4858-a93c-fe79840719e2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:42.290505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ec02bf-4a3c-4858-a93c-fe79840719e2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:42.327670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:42.328472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:42.328804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:42.329085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:42.341600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:42.343055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:42.361861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:42.362830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:42.363726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:42.363726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:42.363726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:42.363726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:42.363726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 458/914] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:42.370228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4f15f-8559-4f60-b73b-485fbfb824c2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:42.477411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e4f15f-8559-4f60-b73b-485fbfb824c2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:42.505049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:42.514795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:42.515643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:42.516108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:42.516390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:42.517109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:42.517411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:42.518790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:42.531245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 457/915] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:42.536662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:42.590907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:42.645207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b981cb-ce9d-4efa-8fa4-d0d9fc03f4ed None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:42.680655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:42.681469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:42.681755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:42.682029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:42.689662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:42.691167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:42.706294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:42.707206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:42.708102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 459/916] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:42.713785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:42.821512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d4efb0-71aa-41e9-b6f0-8325e51c51b0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:42.859322 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb73b4b-2b6a-4827-98a2-c4bd63d34c5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:42.859908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73b4b-2b6a-4827-98a2-c4bd63d34c5a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:42.860189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73b4b-2b6a-4827-98a2-c4bd63d34c5a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:42.860466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb73b4b-2b6a-4827-98a2-c4bd63d34c5a None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:42.861258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb73b4b-2b6a-4827-98a2-c4bd63d34c5a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:42.861596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb73b4b-2b6a-4827-98a2-c4bd63d34c5a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:42.863033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb73b4b-2b6a-4827-98a2-c4bd63d34c5a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:42.876458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 458/917] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:42.882475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:42.884446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cf94e-c5f8-4d15-b842-088882cea220 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:42.884738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cf94e-c5f8-4d15-b842-088882cea220 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:42.885018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1cf94e-c5f8-4d15-b842-088882cea220 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:42.886619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 459/918] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:42.894741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36f75e-1ff2-4efa-be71-e65edd96778a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:42.895032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36f75e-1ff2-4efa-be71-e65edd96778a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:42.895313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c36f75e-1ff2-4efa-be71-e65edd96778a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:42.912640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6c36f75e-1ff2-4efa-be71-e65edd96778a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:42.913869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6c36f75e-1ff2-4efa-be71-e65edd96778a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:42.959589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:42.993525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 460/919] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:42 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:43.010628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36f75e-1ff2-4efa-be71-e65edd96778a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:43.013138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70647ae-95cd-46fc-a86a-9517459f6557 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:43.028870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:43.062612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:43.063952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:43.064456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:43.064928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:43.066538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] RBAC: Adding query filter params (role.id=92329c9509ee4eb383df194d01a90c61, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=b46349b7039e4161ac7f9ac2e477a9d9) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:43.067226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:43.069252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:43.085443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 460/920] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:42 2022] GET /identity/v3/role_assignments?user.id=b46349b7039e4161ac7f9ac2e477a9d9&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=92329c9509ee4eb383df194d01a90c61 => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:43.125960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c36f75e-1ff2-4efa-be71-e65edd96778a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:43.166268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:43.167089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:43.167373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:43.167646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:43.168315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:43.169949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:43.183560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:43.185461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 12 08:24:43.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:43.189828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 461/921] 10.222.0.20 () {56 vars in 1132 bytes} [Tue Jul 12 08:24:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:43.192016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:43.312696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877e0264-9944-4646-a7d6-e5aa75df2877 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:43.348986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:43.350034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:43.350546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:43.351019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:43.351916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:43.352424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:43.354002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:43.360294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 461/922] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:43.365879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:43.410900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:43.477468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a4672a-0ea6-4bc6-b087-682bce1853a2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:43.514528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca26f3f-73cf-4390-8efc-d09832c8446b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:43.515585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26f3f-73cf-4390-8efc-d09832c8446b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:43.516067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26f3f-73cf-4390-8efc-d09832c8446b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:43.516539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca26f3f-73cf-4390-8efc-d09832c8446b None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:43.517460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca26f3f-73cf-4390-8efc-d09832c8446b None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:43.517982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca26f3f-73cf-4390-8efc-d09832c8446b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:43.519556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca26f3f-73cf-4390-8efc-d09832c8446b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:43.525719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 462/923] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:43 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:43.531378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:43.576393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:43.641450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfa8e1f-8649-48ea-a7c4-04e5d86f4e99 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:43.677337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca07a06-285d-4519-a48a-748adaecd80b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:43.677949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07a06-285d-4519-a48a-748adaecd80b None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:43.678228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07a06-285d-4519-a48a-748adaecd80b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:43.678502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca07a06-285d-4519-a48a-748adaecd80b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:43.679252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca07a06-285d-4519-a48a-748adaecd80b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:43.680607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca07a06-285d-4519-a48a-748adaecd80b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:43.702705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 462/924] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:24:43 2022] POST /identity/v3/endpoints => generated 347 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:43.886132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fe1c8-4ec4-4b99-a14f-9987ed237dda None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:43.886648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fe1c8-4ec4-4b99-a14f-9987ed237dda None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:43.886931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2fe1c8-4ec4-4b99-a14f-9987ed237dda None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:43.888490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 463/925] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:43.894020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a8c6-3b43-4a0e-a6f4-0ebf757674c5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:43.894550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a8c6-3b43-4a0e-a6f4-0ebf757674c5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:43.894550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48c8a8c6-3b43-4a0e-a6f4-0ebf757674c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:43.912941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-48c8a8c6-3b43-4a0e-a6f4-0ebf757674c5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:43.914171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-48c8a8c6-3b43-4a0e-a6f4-0ebf757674c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:43.991726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 463/926] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:43 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:44.014318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fe1c8-4ec4-4b99-a14f-9987ed237dda None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:44.090814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af27-8e5d-484d-ae54-7b7f24268b0a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.091986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af27-8e5d-484d-ae54-7b7f24268b0a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.092268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b948af27-8e5d-484d-ae54-7b7f24268b0a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.093935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 464/927] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:44.099482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4f8-0c2c-466f-aad4-9a2b87c7db44 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.100097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4f8-0c2c-466f-aad4-9a2b87c7db44 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.100401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec91b4f8-0c2c-466f-aad4-9a2b87c7db44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.123727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ec91b4f8-0c2c-466f-aad4-9a2b87c7db44 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:44.124915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ec91b4f8-0c2c-466f-aad4-9a2b87c7db44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:44.125241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2fe1c8-4ec4-4b99-a14f-9987ed237dda None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:44.128727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:44.149938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:44.168973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:44.170378 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.170890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.171391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.172190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:44.173824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:44.187123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:44.188315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:44.189158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:44.191963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 464/928] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:44 2022] GET /identity/v3/services/object-store => generated 93 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:44.197918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:44.221606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 465/929] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:44 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:44.237578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b4f8-0c2c-466f-aad4-9a2b87c7db44 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:44.313922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3af150e2-f0a6-4bf9-a050-81db6b986181 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:44.351203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec91b4f8-0c2c-466f-aad4-9a2b87c7db44 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:44.351800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:44.352560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.352914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.353258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.354062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:44.354435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:44.355879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:44.365879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 465/930] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:44 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:44.367493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:44.403865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:44.410998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:44.411941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.412423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.416161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.417109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:44.419223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:44.420818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING keystone.server.flask.common [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 12 08:24:44.443162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.sql.core [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 08:24:44.443162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 08:24:44.443162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [parameters: {'id': 'f621b39b56494099b45463708df70fea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 08:24:44.443162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80191) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f621b39b56494099b45463708df70fea.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f621b39b56494099b45463708df70fea. Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 08:24:44.455137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 12 08:24:44.455919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application yield resource Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise self.value Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application session.commit() Jul 12 08:24:44.456845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.flush() Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application compat.raise_( Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 08:24:44.457764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 08:24:44.458673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 08:24:44.461457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [parameters: {'id': 'f621b39b56494099b45463708df70fea', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:44.464119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:44.466666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id f621b39b56494099b45463708df70fea. Jul 12 08:24:44.469176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:44.479031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 466/931] 10.222.0.20 () {60 vars in 1140 bytes} [Tue Jul 12 08:24:44 2022] POST /identity/v3/projects => generated 262 bytes in 242 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:44.480204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:44.488044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7193610b-ea60-4c3a-9965-c3c125907f31 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:44.490637 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:44.530640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:44.531678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.532291 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.532831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.533828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:44.534342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:44.535972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:44.547390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 466/932] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:44 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:44.548655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:44.592360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-054dfc53-2b01-450b-9204-8b8ca4bef5e2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:44.632380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:44.633174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.633480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.633759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.641251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:44.642937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:44.658173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:44.659147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:44.660112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:44.660112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:44.660112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:44.660112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:44.660112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:44.660112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:44.660112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:44.660112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:44.661959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:44.664730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 467/933] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:44.665532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:44.669523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-274d8311-c844-4eda-b84f-b82751cf04f6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:44.704700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:44.705773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.706262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.706812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.707807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] RBAC: Adding query filter params (interface=public, service_id=6a4a5f3fe6954a8095a01fca059bb539, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:44.708319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:44.709900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:44.715926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 467/934] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 12 08:24:44 2022] GET /identity/v3/endpoints?service_id=6a4a5f3fe6954a8095a01fca059bb539&interface=public®ion_id=RegionOne => generated 194 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:44.721445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:44.744606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:44.791466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-389236d6-fd19-4a46-a1ad-9db4d591273a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:44.843118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a166e33-91b6-41a6-b977-e05e70913dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:44.844375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e33-91b6-41a6-b977-e05e70913dea None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.845096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e33-91b6-41a6-b977-e05e70913dea None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.846010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a166e33-91b6-41a6-b977-e05e70913dea None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.847258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166e33-91b6-41a6-b977-e05e70913dea None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:44.847788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166e33-91b6-41a6-b977-e05e70913dea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:44.848442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7847e979-35e1-4bf4-8009-05b8579fa1a2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:44.849719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a166e33-91b6-41a6-b977-e05e70913dea None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:44.879177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 468/935] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:44 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:44.901605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8dc5056-bc26-4e1d-b09a-723a6e0ed480 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:44.902332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc5056-bc26-4e1d-b09a-723a6e0ed480 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:44.902585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc5056-bc26-4e1d-b09a-723a6e0ed480 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:44.902945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8dc5056-bc26-4e1d-b09a-723a6e0ed480 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:44.904169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc5056-bc26-4e1d-b09a-723a6e0ed480 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:44.905862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8dc5056-bc26-4e1d-b09a-723a6e0ed480 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:44.913872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 468/936] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:24:44 2022] GET /identity/v3/services => generated 1497 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:24:45.183011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bc0fd-e1d9-4c6d-ba62-c7a8dbc4f604 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:45.183978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bc0fd-e1d9-4c6d-ba62-c7a8dbc4f604 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:45.185092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50bc0fd-e1d9-4c6d-ba62-c7a8dbc4f604 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:45.186922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 469/937] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:45 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:45.192583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fbcdb-69f5-46d7-a708-387381b2f4a5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:45.192873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fbcdb-69f5-46d7-a708-387381b2f4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:45.193152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12fbcdb-69f5-46d7-a708-387381b2f4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:45.210382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a12fbcdb-69f5-46d7-a708-387381b2f4a5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:45.211567 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a12fbcdb-69f5-46d7-a708-387381b2f4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:45.231013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:45.285350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 469/938] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:45.307642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bc0fd-e1d9-4c6d-ba62-c7a8dbc4f604 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:45.421078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50bc0fd-e1d9-4c6d-ba62-c7a8dbc4f604 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:45.448631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:45.458549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005801d-e57d-4ae4-ba6d-5dbaec1c54f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:45.459366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005801d-e57d-4ae4-ba6d-5dbaec1c54f4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:45.459643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005801d-e57d-4ae4-ba6d-5dbaec1c54f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:45.459915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005801d-e57d-4ae4-ba6d-5dbaec1c54f4 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:45.471719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005801d-e57d-4ae4-ba6d-5dbaec1c54f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-6005801d-e57d-4ae4-ba6d-5dbaec1c54f4 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:45.479993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:45.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:45.481923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 470/939] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 12 08:24:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:45.487847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fbcdb-69f5-46d7-a708-387381b2f4a5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:45.596329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12fbcdb-69f5-46d7-a708-387381b2f4a5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:45.632614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:45.633683 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:45.634186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:45.634800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:45.635749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:45.636260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:45.638377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:45.647580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 470/940] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 12 08:24:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:45.653670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005801d-e57d-4ae4-ba6d-5dbaec1c54f4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:45.759446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005801d-e57d-4ae4-ba6d-5dbaec1c54f4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:45.795549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a4f9b2-fe1a-4e22-bb5a-14d0b5d5ff58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:45.796338 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f9b2-fe1a-4e22-bb5a-14d0b5d5ff58 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:45.796615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f9b2-fe1a-4e22-bb5a-14d0b5d5ff58 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:45.796887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a4f9b2-fe1a-4e22-bb5a-14d0b5d5ff58 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:45.807819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4f9b2-fe1a-4e22-bb5a-14d0b5d5ff58 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:45.809328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a4f9b2-fe1a-4e22-bb5a-14d0b5d5ff58 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c6a4f9b2-fe1a-4e22-bb5a-14d0b5d5ff58 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:45.827013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:45.827951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:45.828831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:45.828831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:45.828831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:45.828831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:45.828831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 471/941] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:45.834130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:45.856702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:45.863405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de468d7-cef6-45c4-824e-ee4d821f799e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:45.863688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de468d7-cef6-45c4-824e-ee4d821f799e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:45.863962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de468d7-cef6-45c4-824e-ee4d821f799e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:45.865320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 472/942] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:45.870599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d181f5d-db40-43b3-bc63-979231dfdda2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:45.870876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d181f5d-db40-43b3-bc63-979231dfdda2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:45.871171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d181f5d-db40-43b3-bc63-979231dfdda2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:45.889266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2d181f5d-db40-43b3-bc63-979231dfdda2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:45.890795 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2d181f5d-db40-43b3-bc63-979231dfdda2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:45.923297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:45.966438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 473/943] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:45 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:45.972998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c5cb53-f606-4d84-b4c0-95f4946e2b19 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:45.989396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d181f5d-db40-43b3-bc63-979231dfdda2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:46.022483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.023682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.024400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.024869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:46.026360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:46.026888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:46.028294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:46.043442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 471/944] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:46.049568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:46.105917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d181f5d-db40-43b3-bc63-979231dfdda2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:46.139489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:46.148524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.149328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.149633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.149903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:46.150824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:46.152319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:46.165847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728e7ae7-3740-49b5-be4b-df94cfabfeb7 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:46.166376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:46.167528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:46.169103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 474/945] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:45 2022] GET /identity/v3/services/compute => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:46.175377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:46.213726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.214742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.215031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.215389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:46.217977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:46.225558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:46.227087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:46.244961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:46.246084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:46.248111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:46.249557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 472/946] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:24:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:46.252952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:46.308584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fed7d0c-94ea-4b4d-b7de-5e503c76f203 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:46.350821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.352073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.352431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.352773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:46.353845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] RBAC: Adding query filter params (name=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:46.354223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:46.356904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:46.365453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 475/947] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:46 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:46.369806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:46.370976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf732aaf-7c04-4f28-ba55-56a372b60dfc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:46.424857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.425839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.426383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.426819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:46.427979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:46.428530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:46.430312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:46.447898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:46.455727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 473/948] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 12 08:24:46 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:46.457489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:46.484874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:46.491003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaaab06c-fcbc-46f7-b4b3-a2ec58832eae None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:46.529813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.530419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.530699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.530972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:46.531681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:46.531984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:46.533669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:46.540072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 476/949] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:46 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:46.586480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8117692-c4d2-4d1d-a401-69b507a7c946 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:46.627972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.629220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.629694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.630153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:46.643125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:46.644844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:46.665137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:46.666383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:46.667514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:46.667514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:46.667514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:46.667514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:46.673884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 474/950] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:46.675930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:46.787556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cab0e0cd-df60-46ca-a45f-5c25cbe490e1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:46.822603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.823261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.823539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.823809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:46.824527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:46.825624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:46.826998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:46.839743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 477/951] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:46.845603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:46.896787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:46.954834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4c10a2-4135-4b1f-87a3-7a2540fbd0de None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:46.993794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-658ee92e-4378-4cd1-97cf-f38bc59a4abc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:46.995405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ee92e-4378-4cd1-97cf-f38bc59a4abc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:46.995895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ee92e-4378-4cd1-97cf-f38bc59a4abc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:46.996432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-658ee92e-4378-4cd1-97cf-f38bc59a4abc None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.004121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ee92e-4378-4cd1-97cf-f38bc59a4abc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:47.005853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-658ee92e-4378-4cd1-97cf-f38bc59a4abc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-658ee92e-4378-4cd1-97cf-f38bc59a4abc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:47.021050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:47.022018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:47.022926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:47.022926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:47.022926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:47.022926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:47.022926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:47.022926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:47.022926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:47.022926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:47.029380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 475/952] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:47.032334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.056767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:47.068274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8fdf-06a4-4a60-8958-c71e62f21173 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.068561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8fdf-06a4-4a60-8958-c71e62f21173 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.068844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f8fdf-06a4-4a60-8958-c71e62f21173 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.070552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 476/953] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:47.077286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0614dd-1d7d-43db-9430-e28dc5809bf2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.077877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0614dd-1d7d-43db-9430-e28dc5809bf2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.078330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c0614dd-1d7d-43db-9430-e28dc5809bf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.095766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3c0614dd-1d7d-43db-9430-e28dc5809bf2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:47.097245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c0614dd-1d7d-43db-9430-e28dc5809bf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:47.157213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280d3953-5d83-4316-9588-1b96e142cc5e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:47.181437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 477/954] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:47.181437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db574b-3314-48d8-80b5-36be962ac82a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.181437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db574b-3314-48d8-80b5-36be962ac82a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.181437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84db574b-3314-48d8-80b5-36be962ac82a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.181437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 478/955] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:47.183790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3042f-75fc-4b99-a48a-8f9518576781 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.184627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3042f-75fc-4b99-a48a-8f9518576781 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.185026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41f3042f-75fc-4b99-a48a-8f9518576781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.204305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:47.204974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.205257 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.205578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.206532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:47.206854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:47.207104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-41f3042f-75fc-4b99-a48a-8f9518576781 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:47.208286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:47.208395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-41f3042f-75fc-4b99-a48a-8f9518576781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:47.222696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 478/956] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:47 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:47.223515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.245193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:47.290854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 479/957] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:47 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:47.291820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3042f-75fc-4b99-a48a-8f9518576781 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.314129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:47.335916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bf2132a-61c8-457e-b196-15f3eb92ab8d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:47.375959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:47.376678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.376960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.377225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.377935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:47.379291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:47.391532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:47.392585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.393496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 479/958] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:47 2022] GET /identity/v3/services/object-store => generated 93 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:47.395137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.420758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41f3042f-75fc-4b99-a48a-8f9518576781 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:47.468778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf7b83-ff6f-4211-acd1-dc6c90fc93bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:47.469698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf7b83-ff6f-4211-acd1-dc6c90fc93bc None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.469979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf7b83-ff6f-4211-acd1-dc6c90fc93bc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.470250 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cf7b83-ff6f-4211-acd1-dc6c90fc93bc None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/b46349b7039e4161ac7f9ac2e477a9d9/roles/92329c9509ee4eb383df194d01a90c61` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.472555 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf7b83-ff6f-4211-acd1-dc6c90fc93bc None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=b46349b7039e4161ac7f9ac2e477a9d9, role_id=92329c9509ee4eb383df194d01a90c61)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:47.474021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cf7b83-ff6f-4211-acd1-dc6c90fc93bc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:47.497460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 480/959] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:24:47 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/b46349b7039e4161ac7f9ac2e477a9d9/roles/92329c9509ee4eb383df194d01a90c61 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:24:47.497460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf7b83-ff6f-4211-acd1-dc6c90fc93bc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.520184 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312dbbfe-36f2-4e6b-a7f5-6dde0dc641bc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:47.530629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:47.564863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:47.565775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.566058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.566335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.567083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:47.568536 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:47.585168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.sql.core [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 08:24:47.585168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 08:24:47.585168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [parameters: {'user_id': 'c300aebc0db949468fbbf77893c998cd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 08:24:47.585168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80191) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 12 08:24:47.596372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 08:24:47.597444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application yield resource Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application next(self.gen) Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.rollback() Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.force_reraise() Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise self.value Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application session.commit() Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 12 08:24:47.603824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._prepare_impl() Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.session.flush() Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._flush(objects) Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application compat.raise_( Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application flush_context.execute() Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rec.execute(self) Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 12 08:24:47.604747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 12 08:24:47.605704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result = self._query(query) Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application conn.query(q) Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application result.read() Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 12 08:24:47.607656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [parameters: {'user_id': 'c300aebc0db949468fbbf77893c998cd', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:47.609713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 12 08:24:47.611798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 12 08:24:47.614016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 12 08:24:47.614016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 12 08:24:47.614016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 12 08:24:47.614016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 12 08:24:47.614016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 12 08:24:47.614016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.614016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 480/960] 10.222.0.20 () {60 vars in 1131 bytes} [Tue Jul 12 08:24:47 2022] POST /identity/v3/users => generated 160 bytes in 205 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:47.614016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.622781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:47.647705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cf7b83-ff6f-4211-acd1-dc6c90fc93bc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:47.693573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:47.694602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.694886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.695161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.695872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:47.696798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:47.697598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:47.703618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 481/961] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:47 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:47.709609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.750060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b5ac85-3329-421c-8e85-327046fe62ef None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:47.799014 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:47.800464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.801360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.802137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.811549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:47.813538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:47.816128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:47.828375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ec480-1a90-4a0b-90d4-087351ced34f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:47.834679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:47.835661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:47.836630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 481/962] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:24:47 2022] GET /identity/v3/users/cinder => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:47.842052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.877224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:47.878418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:47.878876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:47.879295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:47.880393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:47.880852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:47.882917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:47.889079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 482/963] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:47 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:47.894447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:47.924896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:47.974491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234f409e-5678-4dd2-95b6-af2327f647fc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:48.007140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237e715-8fbc-4b29-b544-bd761a2a1123 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:48.022279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781faf83-ecb8-4f8f-a491-0b691fa5d81e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:48.023668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781faf83-ecb8-4f8f-a491-0b691fa5d81e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:48.024368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781faf83-ecb8-4f8f-a491-0b691fa5d81e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:48.024797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781faf83-ecb8-4f8f-a491-0b691fa5d81e None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:48.026279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781faf83-ecb8-4f8f-a491-0b691fa5d81e None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:48.027137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781faf83-ecb8-4f8f-a491-0b691fa5d81e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:48.028957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-781faf83-ecb8-4f8f-a491-0b691fa5d81e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:48.044975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a47b91-91a2-43a2-9225-c92e4e1fd8b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:48.045770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47b91-91a2-43a2-9225-c92e4e1fd8b3 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:48.046113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47b91-91a2-43a2-9225-c92e4e1fd8b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:48.046457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a47b91-91a2-43a2-9225-c92e4e1fd8b3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:48.047269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47b91-91a2-43a2-9225-c92e4e1fd8b3 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:48.048743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a47b91-91a2-43a2-9225-c92e4e1fd8b3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:48.080055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 482/964] 10.222.0.20 () {56 vars in 1101 bytes} [Tue Jul 12 08:24:47 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:48.084914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 483/965] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:24:47 2022] POST /identity/v3/endpoints => generated 349 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:48.660656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c27dd-3dab-44d3-876c-e1dc95e2d59e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:48.661160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c27dd-3dab-44d3-876c-e1dc95e2d59e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:48.661237 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba0c27dd-3dab-44d3-876c-e1dc95e2d59e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:48.662755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 483/966] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:48.667771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee674-3476-4cb9-9698-d3a6499b0549 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:48.668002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee674-3476-4cb9-9698-d3a6499b0549 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:48.668832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deee674-3476-4cb9-9698-d3a6499b0549 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:48.686711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8deee674-3476-4cb9-9698-d3a6499b0549 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:48.687909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8deee674-3476-4cb9-9698-d3a6499b0549 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:48.691893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:48.764818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 484/967] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:48 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:48.787250 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c27dd-3dab-44d3-876c-e1dc95e2d59e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:48.889074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba0c27dd-3dab-44d3-876c-e1dc95e2d59e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:48.912806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:48.924361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-602fbc67-8716-420e-a3af-50012bab405e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:48.924954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fbc67-8716-420e-a3af-50012bab405e None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:48.925230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fbc67-8716-420e-a3af-50012bab405e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:48.925524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-602fbc67-8716-420e-a3af-50012bab405e None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:48.926251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fbc67-8716-420e-a3af-50012bab405e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:48.927607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-602fbc67-8716-420e-a3af-50012bab405e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:48.943897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 484/968] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:24:48 2022] POST /identity/v3/services => generated 242 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:49.611224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5770-8eee-496b-994c-2ac4cb4a7c7f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:49.611736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5770-8eee-496b-994c-2ac4cb4a7c7f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:49.611813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f7f5770-8eee-496b-994c-2ac4cb4a7c7f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:49.613175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 485/969] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:49.618254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e50d30-9e16-4a0c-b265-ba7129d135ba None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:49.618608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e50d30-9e16-4a0c-b265-ba7129d135ba None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:49.618950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e50d30-9e16-4a0c-b265-ba7129d135ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:49.635982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d1e50d30-9e16-4a0c-b265-ba7129d135ba None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:49.637856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d1e50d30-9e16-4a0c-b265-ba7129d135ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:49.717528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 485/970] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:49 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:49.739711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5770-8eee-496b-994c-2ac4cb4a7c7f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:49.844144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f7f5770-8eee-496b-994c-2ac4cb4a7c7f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:49.878508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef101c-7d47-4e88-a3bd-e805ea5431e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:49.879314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef101c-7d47-4e88-a3bd-e805ea5431e5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:49.879593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef101c-7d47-4e88-a3bd-e805ea5431e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:49.879862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ef101c-7d47-4e88-a3bd-e805ea5431e5 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:49.882587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:49.892019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ef101c-7d47-4e88-a3bd-e805ea5431e5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c9ef101c-7d47-4e88-a3bd-e805ea5431e5 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:49.900221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:49.901444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:24:49.902294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:49.905565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 486/971] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 12 08:24:49 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:49.908138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e50d30-9e16-4a0c-b265-ba7129d135ba None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.009484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e50d30-9e16-4a0c-b265-ba7129d135ba None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.021090 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:50.048212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8cbd72-2b8f-4ba6-8e92-7ba5f7fc397a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.048879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cbd72-2b8f-4ba6-8e92-7ba5f7fc397a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.049159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cbd72-2b8f-4ba6-8e92-7ba5f7fc397a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.049442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8cbd72-2b8f-4ba6-8e92-7ba5f7fc397a None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.050201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cbd72-2b8f-4ba6-8e92-7ba5f7fc397a None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:50.050508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cbd72-2b8f-4ba6-8e92-7ba5f7fc397a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.051871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8cbd72-2b8f-4ba6-8e92-7ba5f7fc397a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.060639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 486/972] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 12 08:24:49 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:50.066584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef101c-7d47-4e88-a3bd-e805ea5431e5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.171386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ef101c-7d47-4e88-a3bd-e805ea5431e5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.184685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9a886-9634-429e-80a0-7ba0d47a02ba None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.184991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9a886-9634-429e-80a0-7ba0d47a02ba None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.185510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e9a886-9634-429e-80a0-7ba0d47a02ba None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.187036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 487/973] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:50.191955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f6f8-2908-436d-8116-9987ca44b537 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.192485 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f6f8-2908-436d-8116-9987ca44b537 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.192966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d51f6f8-2908-436d-8116-9987ca44b537 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.207613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.208393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.208671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.208942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.211180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8d51f6f8-2908-436d-8116-9987ca44b537 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:50.212605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8d51f6f8-2908-436d-8116-9987ca44b537 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:50.220130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.221582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:50.238621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:50.239537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:50.240431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:50.240431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:50.240431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:50.240431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:50.240431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 487/974] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:50.245367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.287193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 488/975] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:50 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:50.296003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:50.309950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51f6f8-2908-436d-8116-9987ca44b537 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.349943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b1d2be7-78c5-4ee4-b0b6-d7a7d157c25e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.386269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.387389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.387814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.388254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.389111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:50.389631 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.391243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.405749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 488/976] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:50.411237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.424669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d51f6f8-2908-436d-8116-9987ca44b537 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.426628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:50.464462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.465806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.466331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.466682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.467336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.468729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:50.480710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:50.482497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:50.483359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 489/977] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:50.488457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.525871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3bfcb40-a176-4d93-a9dd-9e2abbcaf6d6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.537650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:50.566571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.567385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.567666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.567940 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.576194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.577660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:50.593243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:50.594570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:50.595549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 489/978] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:50.599898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.608270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b2959a-8e5b-49c5-99d0-b4691c87322d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.643357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.644368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.644855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.645350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.646279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:50.646767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.648301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.654862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 490/979] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:50.660731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.693035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:50.707233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3e52cc2-ae47-4c77-a6c2-359ff90eafb0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.741601 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b294-7680-444f-9709-c75431757276 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.742273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b294-7680-444f-9709-c75431757276 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.742551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b294-7680-444f-9709-c75431757276 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.742823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f016b294-7680-444f-9709-c75431757276 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.743647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b294-7680-444f-9709-c75431757276 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:50.743961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b294-7680-444f-9709-c75431757276 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.745386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f016b294-7680-444f-9709-c75431757276 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.764105 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 490/980] 10.222.0.20 () {56 vars in 1149 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:50.769814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b294-7680-444f-9709-c75431757276 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.776212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eeb9e44-a004-4350-b537-f5321cf5cb63 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.796849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:50.815062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.816040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.816508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.816981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.817857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:50.818327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.820077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.825805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 491/981] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:50.831435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:50.874264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f016b294-7680-444f-9709-c75431757276 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.908056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b17fd-4d13-4afb-8fc5-4001a7d9c4d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.908702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b17fd-4d13-4afb-8fc5-4001a7d9c4d0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.908977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b17fd-4d13-4afb-8fc5-4001a7d9c4d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.909248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b17fd-4d13-4afb-8fc5-4001a7d9c4d0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.929844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:50.938039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a9ae5-984e-4604-a3af-16e4b4a2b562 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:50.974515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:50.975164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:50.975474 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:50.975745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:50.976469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b17fd-4d13-4afb-8fc5-4001a7d9c4d0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.976588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] RBAC: Adding query filter params (interface=admin, service_id=6a4a5f3fe6954a8095a01fca059bb539, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:50.976822 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:50.977951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b34b17fd-4d13-4afb-8fc5-4001a7d9c4d0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.978215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:50.988428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 492/982] 10.222.0.20 () {56 vars in 1249 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/endpoints?service_id=6a4a5f3fe6954a8095a01fca059bb539&interface=admin®ion_id=RegionOne => generated 193 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:50.989436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.009021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:51.081459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 491/983] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/auth/tokens => generated 1560 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 08:24:51.082838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f3b6-85a2-4b04-930c-a221d3055d93 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.083131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f3b6-85a2-4b04-930c-a221d3055d93 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.083408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3300f3b6-85a2-4b04-930c-a221d3055d93 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.084783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 492/984] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:51.089457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300f3b6-85a2-4b04-930c-a221d3055d93 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.091689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad85f114-abc1-402b-8b82-d7edece37134 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.124897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cdb373-b554-469a-801a-3716297b5843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.125582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb373-b554-469a-801a-3716297b5843 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.125862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb373-b554-469a-801a-3716297b5843 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.126132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cdb373-b554-469a-801a-3716297b5843 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.126806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdb373-b554-469a-801a-3716297b5843 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.128168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cdb373-b554-469a-801a-3716297b5843 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.135037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 493/985] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:24:50 2022] GET /identity/v3/services => generated 1727 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:24:51.136199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a06ed-d1d6-4ec0-b110-8c56bd61a77e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.136482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a06ed-d1d6-4ec0-b110-8c56bd61a77e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.136755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f02a06ed-d1d6-4ec0-b110-8c56bd61a77e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.155220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f02a06ed-d1d6-4ec0-b110-8c56bd61a77e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:51.156460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f02a06ed-d1d6-4ec0-b110-8c56bd61a77e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:51.178909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:51.215783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3300f3b6-85a2-4b04-930c-a221d3055d93 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.242733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 494/986] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:51 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:51.243347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:51.263618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.264432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.264715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.264993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.267313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a06ed-d1d6-4ec0-b110-8c56bd61a77e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.276467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.278534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:51.299160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:51.300106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:51.301303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:51.301303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:51.301303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:51.301303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:51.301303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 493/987] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:51.306208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.380991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f02a06ed-d1d6-4ec0-b110-8c56bd61a77e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.421194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de29deae-ceb5-4709-b9ae-44ea01dfd8bc None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.422496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.423351 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.423625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.423895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.424547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.425937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:51.437877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:51.438882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:51.440362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 495/988] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/services/compute => generated 88 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:51.444905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.462298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.462954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.463230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.463499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.464305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:51.464438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:51.464611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.466847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.481474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 494/989] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:51.485851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.527901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:51.554520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a6ef7e-8f77-4ec4-9d7b-5feaeae0e8d4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.589870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.591129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.591593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.591871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.592583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:51.592885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.594455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.598341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a589dbec-cef9-401f-b265-b666b2b165d9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.599513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 496/990] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:51.604911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.645322 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.646062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.646342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.646613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.655107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.657074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:51.672776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:51.673797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:51.674717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 495/991] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:51.679572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.696112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:51.718817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c81ac12-5a2d-49ef-970c-1e52dbb6e8f0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.753927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.754579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.754856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.755127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.755823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:51.756124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.757616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.768273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 497/992] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:51.769263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.784127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:51.790386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a80d8ad-a926-4d6a-a994-735b31462e4c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.827654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51214014-903f-438f-b194-9131697412a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.828417 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214014-903f-438f-b194-9131697412a5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.828692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214014-903f-438f-b194-9131697412a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.829073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51214014-903f-438f-b194-9131697412a5 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.829881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214014-903f-438f-b194-9131697412a5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:51.830209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214014-903f-438f-b194-9131697412a5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.831742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51214014-903f-438f-b194-9131697412a5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.848836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 496/993] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:51.849894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51214014-903f-438f-b194-9131697412a5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.874309 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a9b1c70-6b2c-4371-80c8-4c20cf8ab697 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.910020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.910590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.910864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.911158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.911904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] RBAC: Adding query filter params (interface=public, service_id=846fcd188a924ac0bc0fe6e3321c429a, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:51.912230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.913596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:51.922990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 498/994] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/endpoints?service_id=846fcd188a924ac0bc0fe6e3321c429a&interface=public®ion_id=RegionOne => generated 194 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:51.923957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:51.935451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:51.958097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51214014-903f-438f-b194-9131697412a5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:51.991465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ed34897-c732-42e2-b9f4-d779e2a8469d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:51.992116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed34897-c732-42e2-b9f4-d779e2a8469d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:51.992398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed34897-c732-42e2-b9f4-d779e2a8469d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:51.992671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ed34897-c732-42e2-b9f4-d779e2a8469d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:51.993525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed34897-c732-42e2-b9f4-d779e2a8469d None admin] RBAC: Adding query filter params (role.id=92329c9509ee4eb383df194d01a90c61, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=b46349b7039e4161ac7f9ac2e477a9d9) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:51.993834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed34897-c732-42e2-b9f4-d779e2a8469d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:51.995255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ed34897-c732-42e2-b9f4-d779e2a8469d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:52.004697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 497/995] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/role_assignments?user.id=b46349b7039e4161ac7f9ac2e477a9d9&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=92329c9509ee4eb383df194d01a90c61 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:52.049435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c625474-88c3-4087-ba16-d6773c656b96 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:52.085269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3fb58e-d490-470b-be99-507dacba302f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:52.085968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb58e-d490-470b-be99-507dacba302f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:52.086246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb58e-d490-470b-be99-507dacba302f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:52.086523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3fb58e-d490-470b-be99-507dacba302f None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:52.087216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fb58e-d490-470b-be99-507dacba302f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:52.088617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f3fb58e-d490-470b-be99-507dacba302f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:52.101465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 499/996] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:24:51 2022] GET /identity/v3/services => generated 1727 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:24:53.189623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce88bb-623e-4029-8df6-07d2033a7bce None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:53.190166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce88bb-623e-4029-8df6-07d2033a7bce None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:53.190166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ce88bb-623e-4029-8df6-07d2033a7bce None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:53.191659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 498/997] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:53.196786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032c07-1d56-4cf1-a168-e3b2fb74a322 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:53.197237 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032c07-1d56-4cf1-a168-e3b2fb74a322 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:53.197582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee032c07-1d56-4cf1-a168-e3b2fb74a322 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:53.214356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ee032c07-1d56-4cf1-a168-e3b2fb74a322 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:53.215708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ee032c07-1d56-4cf1-a168-e3b2fb74a322 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:53.284187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 500/998] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:53 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:53.306619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce88bb-623e-4029-8df6-07d2033a7bce None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:53.331341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:53.408045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ce88bb-623e-4029-8df6-07d2033a7bce None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:53.447265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:53.447993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:53.448264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:53.448528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:53.449166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:53.450688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:53.462444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:53.463418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 12 08:24:53.464264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:53.473471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 499/999] 10.222.0.20 () {56 vars in 1126 bytes} [Tue Jul 12 08:24:53 2022] GET /identity/v3/services/object-store => generated 93 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:53.473597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee032c07-1d56-4cf1-a168-e3b2fb74a322 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:53.473682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:53.574581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee032c07-1d56-4cf1-a168-e3b2fb74a322 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:53.608919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:53.609615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:53.609899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:53.610169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:53.610875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:53.611177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:53.612537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:53.622641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 501/1000] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:53 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:53.623862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:53.713148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:53.729487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f89049-4c48-4512-9c98-65ba433245e5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:53.764973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3489f1-be45-4058-9add-46036cd0f6f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:53.765672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3489f1-be45-4058-9add-46036cd0f6f2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:53.765958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3489f1-be45-4058-9add-46036cd0f6f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:53.766236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3489f1-be45-4058-9add-46036cd0f6f2 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:53.766951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3489f1-be45-4058-9add-46036cd0f6f2 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:53.767260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3489f1-be45-4058-9add-46036cd0f6f2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:53.768637 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3489f1-be45-4058-9add-46036cd0f6f2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:53.779111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 500/1001] 10.222.0.20 () {56 vars in 1122 bytes} [Tue Jul 12 08:24:53 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:53.780043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:53.848151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:53.885688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f08f8fee-93f9-4c33-8cfa-c19a5e2c64b3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:53.920502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27e71f97-d9d8-418f-8d16-b910fbf0496b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:53.921156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71f97-d9d8-418f-8d16-b910fbf0496b None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:53.921453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71f97-d9d8-418f-8d16-b910fbf0496b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:53.921730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27e71f97-d9d8-418f-8d16-b910fbf0496b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:53.922480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e71f97-d9d8-418f-8d16-b910fbf0496b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:53.923839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27e71f97-d9d8-418f-8d16-b910fbf0496b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:53.945460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 502/1002] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:24:53 2022] POST /identity/v3/endpoints => generated 325 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:24:54.087439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c66ab-0f11-4189-a49a-34fbf3883c27 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.087773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c66ab-0f11-4189-a49a-34fbf3883c27 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.087992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54c66ab-0f11-4189-a49a-34fbf3883c27 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.089369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 501/1003] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:54.095297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db8b1c-c499-49a6-bfee-e1dfa4200e60 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.095590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db8b1c-c499-49a6-bfee-e1dfa4200e60 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.095868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2db8b1c-c499-49a6-bfee-e1dfa4200e60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.113080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b2db8b1c-c499-49a6-bfee-e1dfa4200e60 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:54.114292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b2db8b1c-c499-49a6-bfee-e1dfa4200e60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:54.168393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1bbc-9c79-4f50-9499-b8cb6bbe6502 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.168958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1bbc-9c79-4f50-9499-b8cb6bbe6502 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.169276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27ee1bbc-9c79-4f50-9499-b8cb6bbe6502 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.170900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 502/1004] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:24:54.175872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0710f2-4ca4-4e0b-89c8-80cd6f92c832 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.176163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0710f2-4ca4-4e0b-89c8-80cd6f92c832 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.176440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0710f2-4ca4-4e0b-89c8-80cd6f92c832 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.193340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 503/1005] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:54.194592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eb0710f2-4ca4-4e0b-89c8-80cd6f92c832 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:54.195774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eb0710f2-4ca4-4e0b-89c8-80cd6f92c832 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:54.216307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db8b1c-c499-49a6-bfee-e1dfa4200e60 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:54.263786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 503/1006] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:54 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:54.271333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:54.287299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0710f2-4ca4-4e0b-89c8-80cd6f92c832 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:54.323830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2db8b1c-c499-49a6-bfee-e1dfa4200e60 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:54.360317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:54.361341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.361648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.361926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] PATH_INFO: `/v3/services/image` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.362578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:54.363939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:54.372323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:54.377130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:54.378198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:54.379046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 504/1007] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 12 08:24:54 2022] GET /identity/v3/services/image => generated 86 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:54.383910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:54.398959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0710f2-4ca4-4e0b-89c8-80cd6f92c832 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:54.437624 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:54.438733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.438860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.439059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] PATH_INFO: `/v3/services/compute` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.439686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:54.441154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:54.453359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:54.454427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:54.455290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 504/1008] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:54 2022] GET /identity/v3/services/compute => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:54.460424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:54.506032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe152e8e-f4ea-4e8b-b488-e6c75c12f34a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:54.526404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:54.549057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:54.549759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.550041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.550313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.551011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] RBAC: Adding query filter params (name=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:54.551312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:54.552665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:54.557618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 505/1009] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:54 2022] GET /identity/v3/services?name=image => generated 122 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:54.563091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:54.575630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a638c0c-b969-4523-8d25-6b3de9cfce0b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:54.612257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:54.612943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.613224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.613518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.614222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:54.614523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:54.615998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:54.621313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 505/1010] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:54 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:54.626785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:54.638175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:54.664660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf3a24a6-f71b-4752-9324-adf3df04e187 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:54.698310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:54.698964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.699886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.700265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.700956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] RBAC: Adding query filter params (type=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:54.701861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:54.702648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:54.707432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 506/1011] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:54 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:54.735218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ebc222-1ea0-433e-a39a-a83668e0c855 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:54.773315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a36062f-c191-4ee6-9111-536a200b7c51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:54.774024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36062f-c191-4ee6-9111-536a200b7c51 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.774303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36062f-c191-4ee6-9111-536a200b7c51 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.774576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a36062f-c191-4ee6-9111-536a200b7c51 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.775296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36062f-c191-4ee6-9111-536a200b7c51 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:54.775862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36062f-c191-4ee6-9111-536a200b7c51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:54.777256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a36062f-c191-4ee6-9111-536a200b7c51 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:54.787801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 506/1012] 10.222.0.20 () {56 vars in 1112 bytes} [Tue Jul 12 08:24:54 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:54.788797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:54.841400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:54.902235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e8f37f-1db4-416c-989f-11eb24c4f2ab None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:54.937627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012ba9e4-eede-4939-80c7-da924dc374fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:54.938279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba9e4-eede-4939-80c7-da924dc374fa None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:54.938553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba9e4-eede-4939-80c7-da924dc374fa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:54.938819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012ba9e4-eede-4939-80c7-da924dc374fa None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:54.939547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba9e4-eede-4939-80c7-da924dc374fa None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:54.940891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012ba9e4-eede-4939-80c7-da924dc374fa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:54.960798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 507/1013] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:24:54 2022] POST /identity/v3/endpoints => generated 334 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:56.012411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fd5e-9f28-4eb5-a6a1-7e730e2a0890 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:56.013112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fd5e-9f28-4eb5-a6a1-7e730e2a0890 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:56.013112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d081fd5e-9f28-4eb5-a6a1-7e730e2a0890 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:56.014389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 507/1014] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:56.019527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d96d7-dc4a-409d-88c7-fb6c8d31bfed None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:56.019926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d96d7-dc4a-409d-88c7-fb6c8d31bfed None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:56.020089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f5d96d7-dc4a-409d-88c7-fb6c8d31bfed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:56.036906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8f5d96d7-dc4a-409d-88c7-fb6c8d31bfed None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:56.038119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8f5d96d7-dc4a-409d-88c7-fb6c8d31bfed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:56.114603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 508/1015] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:56.138743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081fd5e-9f28-4eb5-a6a1-7e730e2a0890 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:56.216614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:56.248327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d081fd5e-9f28-4eb5-a6a1-7e730e2a0890 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:56.281201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8476d84-e979-4e23-8d15-203ab852316b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:56.282026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8476d84-e979-4e23-8d15-203ab852316b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:56.282303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8476d84-e979-4e23-8d15-203ab852316b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:56.282572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8476d84-e979-4e23-8d15-203ab852316b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:56.283735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8476d84-e979-4e23-8d15-203ab852316b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:56.285146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8476d84-e979-4e23-8d15-203ab852316b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:56.291398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 508/1016] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:56 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:56.292969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d96d7-dc4a-409d-88c7-fb6c8d31bfed None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:56.321554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:56.395970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f5d96d7-dc4a-409d-88c7-fb6c8d31bfed None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:56.436196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdbd5319-65b4-49bc-9d3a-066416900f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:56.437134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd5319-65b4-49bc-9d3a-066416900f42 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:56.437589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd5319-65b4-49bc-9d3a-066416900f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:56.438005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdbd5319-65b4-49bc-9d3a-066416900f42 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:56.438869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd5319-65b4-49bc-9d3a-066416900f42 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:56.440435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdbd5319-65b4-49bc-9d3a-066416900f42 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:56.472777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 509/1017] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:24:56 2022] POST /identity/v3/projects => generated 311 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:56.777152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3b98-58ee-4432-a30b-60ed190ec694 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:56.778040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3b98-58ee-4432-a30b-60ed190ec694 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:56.778429 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e93b3b98-58ee-4432-a30b-60ed190ec694 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:56.780161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 509/1018] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:56.785265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e447d-ac92-4022-bbc2-d659de372b5a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:56.785596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e447d-ac92-4022-bbc2-d659de372b5a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:56.785875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78e447d-ac92-4022-bbc2-d659de372b5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:56.803142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e78e447d-ac92-4022-bbc2-d659de372b5a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:56.804327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e78e447d-ac92-4022-bbc2-d659de372b5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:56.874792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 510/1019] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:56 2022] POST /identity/v3/auth/tokens => generated 1863 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:56.897663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3b98-58ee-4432-a30b-60ed190ec694 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:57.002107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e93b3b98-58ee-4432-a30b-60ed190ec694 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:57.035142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c8f23e0-3307-479d-8cb9-e9b5448df78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:57.035753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f23e0-3307-479d-8cb9-e9b5448df78b None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:57.035989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f23e0-3307-479d-8cb9-e9b5448df78b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:57.036256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c8f23e0-3307-479d-8cb9-e9b5448df78b None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:57.036980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f23e0-3307-479d-8cb9-e9b5448df78b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:57.038362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c8f23e0-3307-479d-8cb9-e9b5448df78b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:57.050040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:57.058066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 510/1020] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:24:56 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:24:57.099202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a3a4-7ffd-411f-8cb9-373a66d05b0e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:57.099755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a3a4-7ffd-411f-8cb9-373a66d05b0e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:57.099755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b57a3a4-7ffd-411f-8cb9-373a66d05b0e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:57.101390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 511/1021] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:57.107599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2165e-ee41-4c4a-9dc2-87b4c877095c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:57.107907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2165e-ee41-4c4a-9dc2-87b4c877095c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:57.108151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25c2165e-ee41-4c4a-9dc2-87b4c877095c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:57.126248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-25c2165e-ee41-4c4a-9dc2-87b4c877095c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:57.127472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-25c2165e-ee41-4c4a-9dc2-87b4c877095c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:57.211826 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 511/1022] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:57 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:24:57.234424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a3a4-7ffd-411f-8cb9-373a66d05b0e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:57.245710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:57.342124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b57a3a4-7ffd-411f-8cb9-373a66d05b0e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:57.376128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ab1b5-7fb8-4943-9c17-03aa4ff69cd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:57.376937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ab1b5-7fb8-4943-9c17-03aa4ff69cd1 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:57.377218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ab1b5-7fb8-4943-9c17-03aa4ff69cd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:57.377519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c04ab1b5-7fb8-4943-9c17-03aa4ff69cd1 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:57.387956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c04ab1b5-7fb8-4943-9c17-03aa4ff69cd1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c04ab1b5-7fb8-4943-9c17-03aa4ff69cd1 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:24:57.396238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:57.397172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:57.398771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 512/1023] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 12 08:24:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:57.404075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2165e-ee41-4c4a-9dc2-87b4c877095c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:57.509767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25c2165e-ee41-4c4a-9dc2-87b4c877095c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:57.536495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:57.546891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:57.547562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:57.547843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:57.548117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:57.548861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:57.549166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:57.550559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:57.563333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 512/1024] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 12 08:24:57 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:57.564595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ab1b5-7fb8-4943-9c17-03aa4ff69cd1 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:57.631978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:57.669006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c04ab1b5-7fb8-4943-9c17-03aa4ff69cd1 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:57.702643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:57.703440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:57.703717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:57.703989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:57.714628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:57.716374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:57.734066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:57.734991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:57.735901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:57.735901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:57.735901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:57.735901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:57.735901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 513/1025] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:57.741871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:57.843964 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a2d2522-b116-43c8-aa25-c6bdf79a5281 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:57.877116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:57.877876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:57.878157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:57.878428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:57.879141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:57.879443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:57.880803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:57.892414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 513/1026] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:57.897750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:57.995552 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-390c08f2-009d-4e3e-877d-660bc68713c8 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:58.015678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:58.031248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676abe-512e-48af-8795-0d734552a55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:58.032032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676abe-512e-48af-8795-0d734552a55b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:58.032311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676abe-512e-48af-8795-0d734552a55b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:58.032582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73676abe-512e-48af-8795-0d734552a55b None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:58.040726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676abe-512e-48af-8795-0d734552a55b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:58.042189 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73676abe-512e-48af-8795-0d734552a55b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-73676abe-512e-48af-8795-0d734552a55b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:24:58.056181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:58.057152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:24:58.058114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:24:58.059841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 514/1027] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:24:57 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:58.063553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:58.112349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:58.165775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53457333-66fb-4e68-af52-bbe2e1f7abd0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:58.202559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:58.203235 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:58.203514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:58.203789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:58.204627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:58.204933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:58.206452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:58.224498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 514/1028] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:24:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:58.229917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676abe-512e-48af-8795-0d734552a55b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:58.329555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73676abe-512e-48af-8795-0d734552a55b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:58.363344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a1b4bc4-de01-415b-bdb3-593256f9f543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:58.363984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b4bc4-de01-415b-bdb3-593256f9f543 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:58.364262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b4bc4-de01-415b-bdb3-593256f9f543 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:58.364536 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a1b4bc4-de01-415b-bdb3-593256f9f543 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:58.416783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:58.443834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b4bc4-de01-415b-bdb3-593256f9f543 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:58.445291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a1b4bc4-de01-415b-bdb3-593256f9f543 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:58.545174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 515/1029] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:24:58 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:24:58.550658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:58.595700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ece1-eb05-4e4d-ac6f-b46d122f5313 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:58.596036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ece1-eb05-4e4d-ac6f-b46d122f5313 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:58.596265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f69ece1-eb05-4e4d-ac6f-b46d122f5313 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:58.597675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 516/1030] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:58.602449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ffdc4-59cb-4076-836d-f435f0f11291 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:58.602738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ffdc4-59cb-4076-836d-f435f0f11291 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:58.603018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8ffdc4-59cb-4076-836d-f435f0f11291 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:58.619436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2f8ffdc4-59cb-4076-836d-f435f0f11291 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:58.620622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2f8ffdc4-59cb-4076-836d-f435f0f11291 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:58.652986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b620fcf1-5237-4407-bff6-fc64ad18eeef None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:58.660852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:58.689787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:58.690494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:58.690775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:58.691049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:58.692783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 517/1031] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:58 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:58.702567 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:58.704014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:58.718066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ffdc4-59cb-4076-836d-f435f0f11291 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:24:58.723396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:58.724286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:58.730027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:24:58.730027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:24:58.730027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:24:58.730027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:58.730027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 515/1032] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:24:58.730308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:58.730393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:58.824464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8ffdc4-59cb-4076-836d-f435f0f11291 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:58.837273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc899b9-9ccb-4de8-b76f-f791542db293 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:58.867250 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a6616-d6a3-476b-a6ce-f102a84fad2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:58.868036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a6616-d6a3-476b-a6ce-f102a84fad2b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:58.868311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a6616-d6a3-476b-a6ce-f102a84fad2b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:58.868583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43a6616-d6a3-476b-a6ce-f102a84fad2b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:58.869761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a6616-d6a3-476b-a6ce-f102a84fad2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:58.871344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43a6616-d6a3-476b-a6ce-f102a84fad2b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:58.873307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 518/1033] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:24:58.881379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a6616-d6a3-476b-a6ce-f102a84fad2b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:58.883238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:58.884799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:58.886227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:58.886822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:58.887611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:58.887929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:58.889301 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:58.906134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 516/1034] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:58.907381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:58.928597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:58.973761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:58.996958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43a6616-d6a3-476b-a6ce-f102a84fad2b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:59.015769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16267e7d-7c36-47b9-8944-b8aa082c0cd5 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:59.034713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034ba1-7141-427b-be2b-5ae36997730b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:59.035380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034ba1-7141-427b-be2b-5ae36997730b None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.035655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034ba1-7141-427b-be2b-5ae36997730b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.036357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76034ba1-7141-427b-be2b-5ae36997730b None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.037077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76034ba1-7141-427b-be2b-5ae36997730b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:59.038526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76034ba1-7141-427b-be2b-5ae36997730b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:59.052084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96dc053f-74f0-4208-bc01-a019058fbb88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:59.053006 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc053f-74f0-4208-bc01-a019058fbb88 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.053356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc053f-74f0-4208-bc01-a019058fbb88 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.053731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96dc053f-74f0-4208-bc01-a019058fbb88 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.069442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc053f-74f0-4208-bc01-a019058fbb88 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:59.069442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96dc053f-74f0-4208-bc01-a019058fbb88 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:59.070179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 519/1035] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:24:58 2022] POST /identity/v3/users => generated 285 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-96dc053f-74f0-4208-bc01-a019058fbb88 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:24:59.086627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:59.087610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:59.088602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 517/1036] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:24:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:59.094488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034ba1-7141-427b-be2b-5ae36997730b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:59.137326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2ccff-50fd-409a-a48d-07599d43e6eb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.137696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2ccff-50fd-409a-a48d-07599d43e6eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.138007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efd2ccff-50fd-409a-a48d-07599d43e6eb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.139785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 518/1037] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:24:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:24:59.145906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7c53-9c64-4fcb-b0f2-ef293febf472 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.146204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7c53-9c64-4fcb-b0f2-ef293febf472 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.146626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd7c53-9c64-4fcb-b0f2-ef293febf472 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.166351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bbcd7c53-9c64-4fcb-b0f2-ef293febf472 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:24:59.167610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bbcd7c53-9c64-4fcb-b0f2-ef293febf472 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:24:59.210734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76034ba1-7141-427b-be2b-5ae36997730b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:59.246175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 519/1038] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:24:59 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:24:59.251836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:59.252499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.252780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.253054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.253879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:59.254190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:59.255618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:59.257546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:59.270797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 520/1039] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:24:59 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:59.270994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd7c53-9c64-4fcb-b0f2-ef293febf472 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:59.285694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:59.286844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:59.389793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd7c53-9c64-4fcb-b0f2-ef293febf472 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:59.404991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc579f87-dbf9-4f03-85b3-4934bb4a3cb6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:59.430422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:59.431488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.431767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.432041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] PATH_INFO: `/v3/services/image` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.432860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:59.435419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:59.444323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:59.444970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.445249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.445555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.446375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] RBAC: Adding query filter params (role.id=92329c9509ee4eb383df194d01a90c61, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=1fe88851e1154cf0838e0cbe47459156) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:59.446685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:59.448077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:24:59.448348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:24:59.454769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:24:59.455748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 520/1040] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 12 08:24:59 2022] GET /identity/v3/services/image => generated 86 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:24:59.456571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:59.470472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 521/1041] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:24:59 2022] GET /identity/v3/role_assignments?user.id=1fe88851e1154cf0838e0cbe47459156&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=92329c9509ee4eb383df194d01a90c61 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:59.546205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:59.578888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3db9067a-abe3-426e-9c52-95d20e5e95b0 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:59.617016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:59.617724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.618011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.618288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.619010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:59.619320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:59.620718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:59.626717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 521/1042] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:59 2022] GET /identity/v3/services?name=image => generated 122 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:59.632550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:59.702331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:59.749084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6662074b-b3c9-428a-b304-8f03bee74558 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:59.784472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:59.785136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.785443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.785721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.786432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] RBAC: Adding query filter params (type=image) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:59.786740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:59.788119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:59.797525 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 522/1043] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:24:59 2022] GET /identity/v3/services?type=image => generated 350 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:59.800421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:24:59.910770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45db24f5-7961-461e-868d-312dd1844677 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:24:59.947196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6c8564-d5b1-4556-8f8b-126a25e2dba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:24:59.947860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8564-d5b1-4556-8f8b-126a25e2dba7 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:24:59.948143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8564-d5b1-4556-8f8b-126a25e2dba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:24:59.948419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6c8564-d5b1-4556-8f8b-126a25e2dba7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:24:59.949248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c8564-d5b1-4556-8f8b-126a25e2dba7 None admin] RBAC: Adding query filter params (interface=public, service_id=dbac20433f224bd2a697ce2fdd6177ca, region_id=RegionOne) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:24:59.949939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c8564-d5b1-4556-8f8b-126a25e2dba7 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:24:59.951604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6c8564-d5b1-4556-8f8b-126a25e2dba7 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:24:59.954019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:24:59.962280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 522/1044] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 12 08:24:59 2022] GET /identity/v3/endpoints?service_id=dbac20433f224bd2a697ce2fdd6177ca&interface=public®ion_id=RegionOne => generated 194 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:24:59.963569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:00.068481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c371bfd-18b3-4816-baf1-653d1a2da1e5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:00.091329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:00.104286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a44432a-8da2-4091-b4d4-8618d3829c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:00.104950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44432a-8da2-4091-b4d4-8618d3829c63 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:00.105232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44432a-8da2-4091-b4d4-8618d3829c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:00.106243 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a44432a-8da2-4091-b4d4-8618d3829c63 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:00.107504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44432a-8da2-4091-b4d4-8618d3829c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:00.108887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a44432a-8da2-4091-b4d4-8618d3829c63 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:00.121706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 523/1045] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:24:59 2022] GET /identity/v3/services => generated 1957 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:25:01.169868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92230a8-6342-42a2-a5cf-af0830204fbf None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.170426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92230a8-6342-42a2-a5cf-af0830204fbf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.170426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92230a8-6342-42a2-a5cf-af0830204fbf None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.171766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 523/1046] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:01.177000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3244122-b7de-4590-877b-1a1e19c2eb79 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.177387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3244122-b7de-4590-877b-1a1e19c2eb79 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.177737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3244122-b7de-4590-877b-1a1e19c2eb79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.195358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b3244122-b7de-4590-877b-1a1e19c2eb79 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:01.196532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b3244122-b7de-4590-877b-1a1e19c2eb79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:01.270972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 524/1047] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:01.295143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92230a8-6342-42a2-a5cf-af0830204fbf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:01.397920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92230a8-6342-42a2-a5cf-af0830204fbf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:01.435329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37db7f48-50ab-49aa-8421-bc41ae19c2e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:01.436043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7f48-50ab-49aa-8421-bc41ae19c2e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.436321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7f48-50ab-49aa-8421-bc41ae19c2e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.436591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37db7f48-50ab-49aa-8421-bc41ae19c2e2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.447377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37db7f48-50ab-49aa-8421-bc41ae19c2e2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-37db7f48-50ab-49aa-8421-bc41ae19c2e2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:01.454993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:01.455885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:01.456712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:01.457954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 524/1048] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:01.462122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3244122-b7de-4590-877b-1a1e19c2eb79 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:01.518548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a6f9a-97f3-4444-b29d-fb76f31e4afd None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.518895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a6f9a-97f3-4444-b29d-fb76f31e4afd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.519101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7a6f9a-97f3-4444-b29d-fb76f31e4afd None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.520728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 525/1049] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:25:01.525798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45b224-cd57-4aa8-859d-daf3321b05de None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.526085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45b224-cd57-4aa8-859d-daf3321b05de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.526364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45b224-cd57-4aa8-859d-daf3321b05de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.544110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7c45b224-cd57-4aa8-859d-daf3321b05de None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:01.545335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c45b224-cd57-4aa8-859d-daf3321b05de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:01.577441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3244122-b7de-4590-877b-1a1e19c2eb79 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:01.595227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:01.609815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:01.617980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:01.618648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.618926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.619213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.619942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:01.620246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:01.622195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:01.623571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 526/1050] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:01 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:25:01.633454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 525/1051] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:01.636446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45b224-cd57-4aa8-859d-daf3321b05de None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:01.647434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:01.742057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45b224-cd57-4aa8-859d-daf3321b05de None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:01.752231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa77d22-543b-4222-ab72-06b0047d958b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:01.779335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15985582-a664-427c-a09b-5f9f2bf58260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:01.780207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985582-a664-427c-a09b-5f9f2bf58260 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.780487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985582-a664-427c-a09b-5f9f2bf58260 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.780872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15985582-a664-427c-a09b-5f9f2bf58260 None admin] PATH_INFO: `/v3/users/f3776f8ea1a94dcd90e38d06e9db0234` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.787787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4002d2-deeb-4bb4-bbfa-5ad5f39e222f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:01.788698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4002d2-deeb-4bb4-bbfa-5ad5f39e222f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.788982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4002d2-deeb-4bb4-bbfa-5ad5f39e222f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.789254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d4002d2-deeb-4bb4-bbfa-5ad5f39e222f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.794866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15985582-a664-427c-a09b-5f9f2bf58260 None admin] RBAC: Authorizing `identity:get_user(user_id=f3776f8ea1a94dcd90e38d06e9db0234)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:01.796312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15985582-a664-427c-a09b-5f9f2bf58260 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:01.802692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 527/1052] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:01 2022] GET /identity/v3/users/f3776f8ea1a94dcd90e38d06e9db0234 => generated 285 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:01.803749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15985582-a664-427c-a09b-5f9f2bf58260 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:01.803875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d4002d2-deeb-4bb4-bbfa-5ad5f39e222f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0d4002d2-deeb-4bb4-bbfa-5ad5f39e222f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:01.816495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:01.817515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:01.819950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 526/1053] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 12 08:25:01 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:25:01.824261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4002d2-deeb-4bb4-bbfa-5ad5f39e222f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:01.865551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:01.868845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:01.926653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15985582-a664-427c-a09b-5f9f2bf58260 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:01.930577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d4002d2-deeb-4bb4-bbfa-5ad5f39e222f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:01.962737 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ac08-1a01-4754-9bf5-e05d28344b4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:01.963387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ac08-1a01-4754-9bf5-e05d28344b4d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.963662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ac08-1a01-4754-9bf5-e05d28344b4d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.963971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd7ac08-1a01-4754-9bf5-e05d28344b4d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.969006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:01.969691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:01.969972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:01.970245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:01.970991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:01.971297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:01.972662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:01.986462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 527/1054] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 12 08:25:01 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:25:01.987429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.042118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ac08-1a01-4754-9bf5-e05d28344b4d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.044234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd7ac08-1a01-4754-9bf5-e05d28344b4d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.097590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:02.114076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:02.117134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af45b5e5-f5f0-4ed5-b18e-63f3387a964e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.157117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 528/1055] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:01 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 08:25:02.162863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ac08-1a01-4754-9bf5-e05d28344b4d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.168080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.168884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.169296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.169604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.181830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.183296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:25:02.201883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:02.202847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:02.203838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:25:02.203838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:25:02.203838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:02.203838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:02.205760 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 528/1056] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:02.208988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.263532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd7ac08-1a01-4754-9bf5-e05d28344b4d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.296526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94ce9483-febc-49b0-861c-fdb084cab3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.297292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9483-febc-49b0-861c-fdb084cab3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.297593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9483-febc-49b0-861c-fdb084cab3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.297859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94ce9483-febc-49b0-861c-fdb084cab3e1 None admin] PATH_INFO: `/v3/projects/29bd1af3310745ee92593423857e7b3a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.299009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce9483-febc-49b0-861c-fdb084cab3e1 None admin] RBAC: Authorizing `identity:get_project(project_id=29bd1af3310745ee92593423857e7b3a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.300423 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94ce9483-febc-49b0-861c-fdb084cab3e1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.302263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 529/1057] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/projects/29bd1af3310745ee92593423857e7b3a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:25:02.303530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4b2c7-a676-4df7-b0fc-2dca68c49cd4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.303808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4b2c7-a676-4df7-b0fc-2dca68c49cd4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.304076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca4b2c7-a676-4df7-b0fc-2dca68c49cd4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.305391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 530/1058] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:02 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:02.308190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4b2c7-a676-4df7-b0fc-2dca68c49cd4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.312278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73fd6ce3-bfef-40be-b0a5-1ede80619e28 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.327472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:02.345998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f0be50-f837-456a-90a2-b2ea9794bc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.346642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0be50-f837-456a-90a2-b2ea9794bc84 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.346922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0be50-f837-456a-90a2-b2ea9794bc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.347191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f0be50-f837-456a-90a2-b2ea9794bc84 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.347898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0be50-f837-456a-90a2-b2ea9794bc84 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:02.348198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0be50-f837-456a-90a2-b2ea9794bc84 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.349696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f0be50-f837-456a-90a2-b2ea9794bc84 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.361739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 529/1059] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:02.362961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669e5d-c981-4e2f-b465-5b859b37b7e6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.363248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669e5d-c981-4e2f-b465-5b859b37b7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.363525 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94669e5d-c981-4e2f-b465-5b859b37b7e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.379786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-94669e5d-c981-4e2f-b465-5b859b37b7e6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:02.380967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-94669e5d-c981-4e2f-b465-5b859b37b7e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:02.389126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:02.414359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca4b2c7-a676-4df7-b0fc-2dca68c49cd4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.448705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.450529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.450816 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.451186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.452324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=29bd1af3310745ee92593423857e7b3a, user.id=f3776f8ea1a94dcd90e38d06e9db0234) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:02.452865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.455269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.455928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 530/1060] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:02 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:02.456751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94669e5d-c981-4e2f-b465-5b859b37b7e6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.477950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 531/1061] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/role_assignments?user.id=f3776f8ea1a94dcd90e38d06e9db0234&scope.project.id=29bd1af3310745ee92593423857e7b3a&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:02.479940 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.568161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94669e5d-c981-4e2f-b465-5b859b37b7e6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.568670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:02.592487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0099c0-c986-462d-870b-533811fd2580 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.604542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.605366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.605855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.606132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.614345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.616095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.631001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:25:02.631605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:02.632512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:25:02.633495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:02.634043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.634043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.634043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] PATH_INFO: `/v3/services/image` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.634043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.634291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 531/1062] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:02.634361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.640950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.644633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:02.650904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:02.651938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:02.652832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 532/1063] 10.222.0.20 () {56 vars in 1105 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:25:02.657853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.754447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c0c70a5-12bd-48c3-884d-6122c7411960 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.761761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51731ea4-911f-4996-a921-267d302bd92d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.790725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.791388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.791667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.792125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.792757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:02.793864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.795300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.797513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.798179 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.798511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.798785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.799502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] RBAC: Adding query filter params (name=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:02.799810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.801139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.806453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 533/1064] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/services?name=image => generated 122 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:25:02.811848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.820914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 532/1065] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:02.821915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.822634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:02.887701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:02.919510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6868c603-cd50-44f6-b42c-29be80fcd0a3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.931408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a4583e-fa3b-4351-80db-8c27aaaeb9e6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:02.955174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.955918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.956198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.956466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.957164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:02.957500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.958868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:02.963823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 534/1066] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/services?type=image => generated 350 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:25:02.969360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:02.969564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:02.970500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:02.970933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:02.971343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:02.982759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:02.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:25:03.003181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:03.004157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:03.005146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:25:03.005146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:25:03.005146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:03.005146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:03.005146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 533/1067] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:03.010061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:03.045231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:03.082330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fcdc05-853d-457f-9ab9-7dce113c13c3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:03.119096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a05d4c-4d79-45c6-981e-b400e2a30dbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:03.120029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05d4c-4d79-45c6-981e-b400e2a30dbe None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:03.120303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05d4c-4d79-45c6-981e-b400e2a30dbe None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:03.120568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a05d4c-4d79-45c6-981e-b400e2a30dbe None admin] PATH_INFO: `/v3/endpoints` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:03.121991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a05d4c-4d79-45c6-981e-b400e2a30dbe None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:03.123533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a05d4c-4d79-45c6-981e-b400e2a30dbe None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:03.130205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d57c9d9-31c5-4d2d-89e8-5c6eb3fd7edd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:03.144487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:03.145931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 535/1068] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:25:02 2022] POST /identity/v3/endpoints => generated 327 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:25:03.177838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:03.178514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:03.178789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:03.179055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:03.179787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:03.180089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:03.181504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:03.200341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 534/1069] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:25:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:25:03.202285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a05d4c-4d79-45c6-981e-b400e2a30dbe None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:03.312668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a05d4c-4d79-45c6-981e-b400e2a30dbe None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:03.340969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:03.352293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:03.353170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:03.353524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:03.353803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:03.360818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:03.362317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:25:03.377227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:03.378309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:03.379260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 536/1070] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:25:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:03.384579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:03.490660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904c33ac-cb9d-4ca1-bb8f-a9f5f86e507f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:03.524126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf5d81-6445-4aec-8d09-961ba6473ae5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:03.524782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5d81-6445-4aec-8d09-961ba6473ae5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:03.525061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5d81-6445-4aec-8d09-961ba6473ae5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:03.525611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf5d81-6445-4aec-8d09-961ba6473ae5 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:03.526392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf5d81-6445-4aec-8d09-961ba6473ae5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:03.526695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf5d81-6445-4aec-8d09-961ba6473ae5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:03.528173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf5d81-6445-4aec-8d09-961ba6473ae5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:03.540324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 535/1071] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:25:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:03.546478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:03.650945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b828e638-f11d-4e0d-9cd1-ef42c564ced2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:03.687860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a5ad51-2496-4c37-8d28-e689057fe2d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:03.688744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5ad51-2496-4c37-8d28-e689057fe2d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:03.689027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5ad51-2496-4c37-8d28-e689057fe2d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:03.689301 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a5ad51-2496-4c37-8d28-e689057fe2d9 None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/1fe88851e1154cf0838e0cbe47459156/roles/92329c9509ee4eb383df194d01a90c61` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:03.691514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5ad51-2496-4c37-8d28-e689057fe2d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=1fe88851e1154cf0838e0cbe47459156, role_id=92329c9509ee4eb383df194d01a90c61)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:03.692952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a5ad51-2496-4c37-8d28-e689057fe2d9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:03.707498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 537/1072] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:25:03 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/1fe88851e1154cf0838e0cbe47459156/roles/92329c9509ee4eb383df194d01a90c61 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:25:04.512020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db8669-3e34-4ddc-8724-647de5641225 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:04.512534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db8669-3e34-4ddc-8724-647de5641225 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:04.512611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47db8669-3e34-4ddc-8724-647de5641225 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:04.513999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 536/1073] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:04.519059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797c91-e86f-4a87-801c-7bd05f78e258 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:04.519431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797c91-e86f-4a87-801c-7bd05f78e258 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:04.519605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b797c91-e86f-4a87-801c-7bd05f78e258 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:04.536189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2b797c91-e86f-4a87-801c-7bd05f78e258 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:04.537360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2b797c91-e86f-4a87-801c-7bd05f78e258 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:04.581020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:04.607245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 538/1074] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:04.629610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db8669-3e34-4ddc-8724-647de5641225 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:04.659254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:04.734588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47db8669-3e34-4ddc-8724-647de5641225 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:04.768449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10635ad4-aaae-42fa-b784-b1d26fff0d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:04.769235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635ad4-aaae-42fa-b784-b1d26fff0d15 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:04.769540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635ad4-aaae-42fa-b784-b1d26fff0d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:04.769810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10635ad4-aaae-42fa-b784-b1d26fff0d15 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:04.781190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10635ad4-aaae-42fa-b784-b1d26fff0d15 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-10635ad4-aaae-42fa-b784-b1d26fff0d15 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:04.788705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:04.789652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:04.790527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:04.793497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 537/1075] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:04.796819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797c91-e86f-4a87-801c-7bd05f78e258 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:04.899168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b797c91-e86f-4a87-801c-7bd05f78e258 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:04.933480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:04.934325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:04.934608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:04.934880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:04.935617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:04.935920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:04.937277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:04.949445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 539/1076] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:04.951285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10635ad4-aaae-42fa-b784-b1d26fff0d15 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:05.042205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:05.055778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10635ad4-aaae-42fa-b784-b1d26fff0d15 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:05.089192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4968e58c-209c-418b-99e2-41fe744063f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:05.090870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e58c-209c-418b-99e2-41fe744063f9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.091142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e58c-209c-418b-99e2-41fe744063f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.091412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4968e58c-209c-418b-99e2-41fe744063f9 None admin] PATH_INFO: `/v3/users/f3776f8ea1a94dcd90e38d06e9db0234` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.092586 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968e58c-209c-418b-99e2-41fe744063f9 None admin] RBAC: Authorizing `identity:get_user(user_id=f3776f8ea1a94dcd90e38d06e9db0234)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:05.094030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4968e58c-209c-418b-99e2-41fe744063f9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:05.100577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 538/1077] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:04 2022] GET /identity/v3/users/f3776f8ea1a94dcd90e38d06e9db0234 => generated 285 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:05.101827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:05.146276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:05.206750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df73561a-ca5e-4949-9e8f-7599f0994a46 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:05.235201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c686-d7e7-4362-b66f-43230bccea3a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.235476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c686-d7e7-4362-b66f-43230bccea3a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.235747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb1c686-d7e7-4362-b66f-43230bccea3a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.237117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 539/1078] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:25:05.242319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f95bb-d3b9-41c4-87d1-4d363f14553c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.242600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f95bb-d3b9-41c4-87d1-4d363f14553c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.242873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-842f95bb-d3b9-41c4-87d1-4d363f14553c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.243791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff019bb-ecd4-4634-9b8e-593dcac30f1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:05.244647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff019bb-ecd4-4634-9b8e-593dcac30f1f None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.244929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff019bb-ecd4-4634-9b8e-593dcac30f1f None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.245200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff019bb-ecd4-4634-9b8e-593dcac30f1f None admin] PATH_INFO: `/v3/projects/29bd1af3310745ee92593423857e7b3a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.246973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff019bb-ecd4-4634-9b8e-593dcac30f1f None admin] RBAC: Authorizing `identity:get_project(project_id=29bd1af3310745ee92593423857e7b3a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:05.248461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff019bb-ecd4-4634-9b8e-593dcac30f1f None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:05.250337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 540/1079] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:05 2022] GET /identity/v3/projects/29bd1af3310745ee92593423857e7b3a => generated 311 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:05.256775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff019bb-ecd4-4634-9b8e-593dcac30f1f None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:05.262241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-842f95bb-d3b9-41c4-87d1-4d363f14553c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:05.263529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-842f95bb-d3b9-41c4-87d1-4d363f14553c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:05.338208 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 540/1080] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:05.357343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f95bb-d3b9-41c4-87d1-4d363f14553c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:05.362891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff019bb-ecd4-4634-9b8e-593dcac30f1f None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:05.374755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:05.407447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6c38-973e-4834-9d0b-28ad0e1d683b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:05.408335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6c38-973e-4834-9d0b-28ad0e1d683b None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.408767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6c38-973e-4834-9d0b-28ad0e1d683b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.409047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473e6c38-973e-4834-9d0b-28ad0e1d683b None admin] PATH_INFO: `/v3/projects/29bd1af3310745ee92593423857e7b3a/users/f3776f8ea1a94dcd90e38d06e9db0234/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.414356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e6c38-973e-4834-9d0b-28ad0e1d683b None admin] RBAC: Authorizing `identity:create_grant(project_id=29bd1af3310745ee92593423857e7b3a, user_id=f3776f8ea1a94dcd90e38d06e9db0234, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:05.416744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473e6c38-973e-4834-9d0b-28ad0e1d683b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:05.433215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 541/1081] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:25:05 2022] PUT /identity/v3/projects/29bd1af3310745ee92593423857e7b3a/users/f3776f8ea1a94dcd90e38d06e9db0234/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:25:05.454996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:05.473697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-842f95bb-d3b9-41c4-87d1-4d363f14553c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:05.513166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b095e57f-a42b-4198-8944-a13431b2a923 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:05.513870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095e57f-a42b-4198-8944-a13431b2a923 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.514147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095e57f-a42b-4198-8944-a13431b2a923 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.514413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b095e57f-a42b-4198-8944-a13431b2a923 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.588880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095e57f-a42b-4198-8944-a13431b2a923 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:05.591299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b095e57f-a42b-4198-8944-a13431b2a923 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:05.679421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:05.696460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 541/1082] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 12 08:25:05.702688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6c38-973e-4834-9d0b-28ad0e1d683b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:05.763548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272898c-4b42-4560-a6c0-39ebe5dbdc6f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.763915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272898c-4b42-4560-a6c0-39ebe5dbdc6f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.764114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a272898c-4b42-4560-a6c0-39ebe5dbdc6f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.769175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 542/1083] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:05.770434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321249a-69c8-4dba-b275-6035b41d206c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.770721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321249a-69c8-4dba-b275-6035b41d206c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.771000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321249a-69c8-4dba-b275-6035b41d206c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.788648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4321249a-69c8-4dba-b275-6035b41d206c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:05.789874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4321249a-69c8-4dba-b275-6035b41d206c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:05.817108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473e6c38-973e-4834-9d0b-28ad0e1d683b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:05.853236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:05.853961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:05.854238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:05.854597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:05.860851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 543/1084] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:05.866019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:05.867455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:05.884131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321249a-69c8-4dba-b275-6035b41d206c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:25:05.884557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:05.885671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:05.887804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:25:05.887804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:25:05.887804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:05.887804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:05.887804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 542/1085] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:05.892384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:05.916492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:05.989672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321249a-69c8-4dba-b275-6035b41d206c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:05.998382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28d1958-c2cf-468a-a116-f97d7564eb62 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:06.010248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:06.032111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083297-be8e-47e4-b872-bf6c081d4007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:06.032896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083297-be8e-47e4-b872-bf6c081d4007 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:06.033176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083297-be8e-47e4-b872-bf6c081d4007 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:06.033469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05083297-be8e-47e4-b872-bf6c081d4007 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:06.034023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:06.034675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:06.034950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:06.035218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:06.035927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:06.036219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:06.037614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:06.045322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05083297-be8e-47e4-b872-bf6c081d4007 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:06.061449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 543/1086] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:25:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-05083297-be8e-47e4-b872-bf6c081d4007 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:06.061657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:06.062756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:06.063778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 544/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Tue Jul 12 08:25:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:25:06.064628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:06.155157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:06.176542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3e46c4-3894-43ab-86b3-2f6a38a92098 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:06.213329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:06.214045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:06.214329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:06.215101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:06.215967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:06.216276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:06.217661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:06.226898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 544/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 12 08:25:06 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:06.233042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083297-be8e-47e4-b872-bf6c081d4007 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:06.343165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05083297-be8e-47e4-b872-bf6c081d4007 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:06.377735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:06.378524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:06.378806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:06.379082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:06.389628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:06.391104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:25:06.408828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:06.409814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:06.410709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:25:06.410709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:25:06.410709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:06.410709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:06.411280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 545/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:25:06.416011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:06.523231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4102bab3-11b6-4ea2-89c2-1806191680d4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:06.560790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:06.561487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:06.561757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:06.562033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:06.562757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:06.563065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:06.564436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:06.577619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 545/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:25:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:06.583101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:06.611374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:06.681535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78d32ab7-d098-44d3-be78-91f56ca9b756 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:06.713929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:06.714746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:06.715026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:06.715290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:06.722390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:06.723808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:25:06.737849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:06.738861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:06.739815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 546/1091] 10.222.0.20 () {56 vars in 1093 bytes} [Tue Jul 12 08:25:06 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:06.744759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:06.748435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:06.841352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10a77966-e4e5-43a5-929d-c4839becd13c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:06.874767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:06.875421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:06.875699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:06.875974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:06.876796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:06.877101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:06.878549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:06.895016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 546/1092] 10.222.0.20 () {56 vars in 1133 bytes} [Tue Jul 12 08:25:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:06.901046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:06.987831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:06.999882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4c1c4b-66bc-4d28-89a7-98f5a9177332 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:07.032655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0db6-632b-4e80-9979-afbcf2329e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:07.033294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0db6-632b-4e80-9979-afbcf2329e92 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.033605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0db6-632b-4e80-9979-afbcf2329e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.033878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ea0db6-632b-4e80-9979-afbcf2329e92 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.098902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0db6-632b-4e80-9979-afbcf2329e92 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:07.100345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ea0db6-632b-4e80-9979-afbcf2329e92 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:07.185656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:07.198534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 547/1093] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:06 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 298 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:07.204622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:07.264498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:07.305619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f0736a-5e85-405e-b764-3448c05a8126 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:07.338416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb8d293-43c5-4dde-9f60-726f33de44db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:07.339200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d293-43c5-4dde-9f60-726f33de44db None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.339478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d293-43c5-4dde-9f60-726f33de44db None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.340373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb8d293-43c5-4dde-9f60-726f33de44db None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.350099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d293-43c5-4dde-9f60-726f33de44db None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:07.351531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb8d293-43c5-4dde-9f60-726f33de44db None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-bdb8d293-43c5-4dde-9f60-726f33de44db None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:25:07.368541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:07.369598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:07.370875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:25:07.370875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:25:07.370875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:25:07.370875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:07.370875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 547/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:25:07.375537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0db6-632b-4e80-9979-afbcf2329e92 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:07.472148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5513-3433-4713-8323-cf49eebfb0c6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.472621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5513-3433-4713-8323-cf49eebfb0c6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.473085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf5513-3433-4713-8323-cf49eebfb0c6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.475633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 548/1095] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:07.479722 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ea0db6-632b-4e80-9979-afbcf2329e92 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:07.480945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa523f61-af78-49cb-9481-a281d2209300 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.482487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa523f61-af78-49cb-9481-a281d2209300 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.482772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa523f61-af78-49cb-9481-a281d2209300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.499724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-aa523f61-af78-49cb-9481-a281d2209300 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:07.500903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aa523f61-af78-49cb-9481-a281d2209300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:07.515158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:07.515743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.516022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.516297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.517001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:07.517304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:07.518686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:07.530314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 548/1096] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:25:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:07.535714 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:07.568800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 549/1097] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:07 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:25:07.584686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:07.600509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa523f61-af78-49cb-9481-a281d2209300 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:07.634577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:07.637732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c83e581d-f94e-4737-a881-17da2f6563b9 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:07.672479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:07.673264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.673575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.673848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.680509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:07.682011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:07.690218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa523f61-af78-49cb-9481-a281d2209300 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:25:07.695814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:07.696845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:07.697823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 549/1098] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:25:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:25:07.702730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:07.726493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9ba81-f2fd-43eb-a3c0-e62e9309cad2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:07.727273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ba81-f2fd-43eb-a3c0-e62e9309cad2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.727549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ba81-f2fd-43eb-a3c0-e62e9309cad2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.727826 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d9ba81-f2fd-43eb-a3c0-e62e9309cad2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.738122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d9ba81-f2fd-43eb-a3c0-e62e9309cad2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-45d9ba81-f2fd-43eb-a3c0-e62e9309cad2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:07.745612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:07.747340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:07.748243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 550/1099] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:25:07.752597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9ba81-f2fd-43eb-a3c0-e62e9309cad2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:07.802496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38fe2af1-2bda-40df-b06b-ee2866992fa6 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:07.812558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:07.837979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:07.838627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.838910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.839190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.840000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:07.840398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:07.841863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:07.849408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d9ba81-f2fd-43eb-a3c0-e62e9309cad2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:07.850990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:07.859687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 550/1100] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:25:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:25:07.860860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:07.886256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:07.887538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.887813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.888086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.888814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:07.889112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:07.890500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:07.898260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 551/1101] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:25:07.904698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:07.960233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be09560b-174a-4739-a629-43c96ed62d82 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:07.992962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:07.993629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:07.993910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:07.994192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:07.995006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] RBAC: Adding query filter params (role.id=92329c9509ee4eb383df194d01a90c61, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=1fe88851e1154cf0838e0cbe47459156) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:07.995315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:07.996808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:08.001717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e242eaa-8b03-4eba-aac0-ed7c611f6c7e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:08.002584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 551/1102] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:07 2022] GET /identity/v3/role_assignments?user.id=1fe88851e1154cf0838e0cbe47459156&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=92329c9509ee4eb383df194d01a90c61 => generated 608 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:25:08.037298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1bd70-a98b-4ec5-942c-4d0b7ccad847 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:08.038215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1bd70-a98b-4ec5-942c-4d0b7ccad847 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:08.038493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1bd70-a98b-4ec5-942c-4d0b7ccad847 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:08.038769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f1bd70-a98b-4ec5-942c-4d0b7ccad847 None admin] PATH_INFO: `/v3/users/f3776f8ea1a94dcd90e38d06e9db0234` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:08.040029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1bd70-a98b-4ec5-942c-4d0b7ccad847 None admin] RBAC: Authorizing `identity:get_user(user_id=f3776f8ea1a94dcd90e38d06e9db0234)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:08.041490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f1bd70-a98b-4ec5-942c-4d0b7ccad847 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:08.044065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 552/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:07 2022] GET /identity/v3/users/f3776f8ea1a94dcd90e38d06e9db0234 => generated 285 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:08.050229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:08.085057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:08.157439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d0404f1-8ec2-4536-9915-ba424b946cea None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:08.197238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b6d2-3bfb-4346-92f1-c9c7771b607e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:08.197910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b6d2-3bfb-4346-92f1-c9c7771b607e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:08.198193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b6d2-3bfb-4346-92f1-c9c7771b607e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:08.198467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e93b6d2-3bfb-4346-92f1-c9c7771b607e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:08.267301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b6d2-3bfb-4346-92f1-c9c7771b607e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:08.268750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e93b6d2-3bfb-4346-92f1-c9c7771b607e None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:08.299993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:08.372176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 552/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:08 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:08.378100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1bd70-a98b-4ec5-942c-4d0b7ccad847 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:08.410818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:08.484701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f1bd70-a98b-4ec5-942c-4d0b7ccad847 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:08.518363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dc44294-370a-492a-bafc-3537f99b785c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:08.519238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44294-370a-492a-bafc-3537f99b785c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:08.519516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44294-370a-492a-bafc-3537f99b785c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:08.519788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dc44294-370a-492a-bafc-3537f99b785c None admin] PATH_INFO: `/v3/projects/29bd1af3310745ee92593423857e7b3a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:08.520972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44294-370a-492a-bafc-3537f99b785c None admin] RBAC: Authorizing `identity:get_project(project_id=29bd1af3310745ee92593423857e7b3a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:08.522420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dc44294-370a-492a-bafc-3537f99b785c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:08.524108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 553/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:08 2022] GET /identity/v3/projects/29bd1af3310745ee92593423857e7b3a => generated 311 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:08.532447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b6d2-3bfb-4346-92f1-c9c7771b607e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:08.635783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e93b6d2-3bfb-4346-92f1-c9c7771b607e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:08.665824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:08.672111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ecf26f-a0ea-4366-972f-d97741d5e28f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:08.672763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecf26f-a0ea-4366-972f-d97741d5e28f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:08.673040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecf26f-a0ea-4366-972f-d97741d5e28f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:08.673312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ecf26f-a0ea-4366-972f-d97741d5e28f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:08.674167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecf26f-a0ea-4366-972f-d97741d5e28f None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=29bd1af3310745ee92593423857e7b3a, user.id=f3776f8ea1a94dcd90e38d06e9db0234) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:08.674473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecf26f-a0ea-4366-972f-d97741d5e28f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:08.675996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ecf26f-a0ea-4366-972f-d97741d5e28f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:08.682134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 553/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:08 2022] GET /identity/v3/role_assignments?user.id=f3776f8ea1a94dcd90e38d06e9db0234&scope.project.id=29bd1af3310745ee92593423857e7b3a&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:10.738934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837666ce-f650-4214-a87d-d0efd27baefe None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:10.739458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837666ce-f650-4214-a87d-d0efd27baefe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:10.739458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837666ce-f650-4214-a87d-d0efd27baefe None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:10.740773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 554/1107] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:10.746316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108857cd-fa15-4f22-b3f4-df932144ffd5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:10.746726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108857cd-fa15-4f22-b3f4-df932144ffd5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:10.747040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108857cd-fa15-4f22-b3f4-df932144ffd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:10.763862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-108857cd-fa15-4f22-b3f4-df932144ffd5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:10.765022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-108857cd-fa15-4f22-b3f4-df932144ffd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:10.828145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 554/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:10.852434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837666ce-f650-4214-a87d-d0efd27baefe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:10.947037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:10.952062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837666ce-f650-4214-a87d-d0efd27baefe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:10.984358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e153349b-824d-4af5-bd96-3daceb5b1702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:10.985123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153349b-824d-4af5-bd96-3daceb5b1702 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:10.985399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153349b-824d-4af5-bd96-3daceb5b1702 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:10.985696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e153349b-824d-4af5-bd96-3daceb5b1702 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:10.986833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153349b-824d-4af5-bd96-3daceb5b1702 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:10.988244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e153349b-824d-4af5-bd96-3daceb5b1702 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:10.989896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 555/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:10 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:10.995452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108857cd-fa15-4f22-b3f4-df932144ffd5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:11.090861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108857cd-fa15-4f22-b3f4-df932144ffd5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:11.116546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:11.126101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422abc91-039a-4705-8442-804194196a09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:11.126765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422abc91-039a-4705-8442-804194196a09 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:11.127044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422abc91-039a-4705-8442-804194196a09 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:11.127315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422abc91-039a-4705-8442-804194196a09 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:11.128019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422abc91-039a-4705-8442-804194196a09 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:11.129473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422abc91-039a-4705-8442-804194196a09 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:11.150572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 555/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:25:10 2022] POST /identity/v3/users => generated 286 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:25:13.293795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a0029-1d7b-4f03-8e3d-36d9c81bfe77 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:13.294398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a0029-1d7b-4f03-8e3d-36d9c81bfe77 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:13.294398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49a0029-1d7b-4f03-8e3d-36d9c81bfe77 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:13.295895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 556/1111] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:13.304155 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082887-5194-4a59-9b2e-c4bba16d34c5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:13.304155 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082887-5194-4a59-9b2e-c4bba16d34c5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:13.304155 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8082887-5194-4a59-9b2e-c4bba16d34c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:13.325708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f8082887-5194-4a59-9b2e-c4bba16d34c5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:13.326919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f8082887-5194-4a59-9b2e-c4bba16d34c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:13.408137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 556/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:13 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:13.433403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a0029-1d7b-4f03-8e3d-36d9c81bfe77 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:13.548366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49a0029-1d7b-4f03-8e3d-36d9c81bfe77 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:13.582742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240da50-9df7-4b0c-8446-842d65e3c856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:13.583592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240da50-9df7-4b0c-8446-842d65e3c856 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:13.583872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240da50-9df7-4b0c-8446-842d65e3c856 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:13.584146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1240da50-9df7-4b0c-8446-842d65e3c856 None admin] PATH_INFO: `/v3/roles/dd9d89d3dbf5451ba6661a3634837e37` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:13.585618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240da50-9df7-4b0c-8446-842d65e3c856 None admin] RBAC: Authorizing `identity:get_role(role_id=dd9d89d3dbf5451ba6661a3634837e37)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:13.586973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1240da50-9df7-4b0c-8446-842d65e3c856 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:13.588336 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 557/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:13 2022] GET /identity/v3/roles/dd9d89d3dbf5451ba6661a3634837e37 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:13.594775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8082887-5194-4a59-9b2e-c4bba16d34c5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:13.690705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8082887-5194-4a59-9b2e-c4bba16d34c5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:13.703761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:13.725158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0dd9f-3df5-46c4-895c-65b6cd510c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:13.726040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0dd9f-3df5-46c4-895c-65b6cd510c84 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:13.726321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0dd9f-3df5-46c4-895c-65b6cd510c84 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:13.726593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ca0dd9f-3df5-46c4-895c-65b6cd510c84 None admin] PATH_INFO: `/v3/users/07b5e91af46d4372bc76388e7db89562` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:13.739227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0dd9f-3df5-46c4-895c-65b6cd510c84 None admin] RBAC: Authorizing `identity:get_user(user_id=07b5e91af46d4372bc76388e7db89562)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:13.740660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ca0dd9f-3df5-46c4-895c-65b6cd510c84 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:13.742326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 557/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:13 2022] GET /identity/v3/users/07b5e91af46d4372bc76388e7db89562 => generated 286 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:13.748891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240da50-9df7-4b0c-8446-842d65e3c856 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:13.784383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:13.846178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1240da50-9df7-4b0c-8446-842d65e3c856 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:13.878985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58d768-8954-43af-a1ca-e1f2d7617be6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:13.879616 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58d768-8954-43af-a1ca-e1f2d7617be6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:13.879896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58d768-8954-43af-a1ca-e1f2d7617be6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:13.880171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b58d768-8954-43af-a1ca-e1f2d7617be6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:13.944151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58d768-8954-43af-a1ca-e1f2d7617be6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:13.945610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b58d768-8954-43af-a1ca-e1f2d7617be6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:13.977796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:14.039606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 558/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:13 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:14.046080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0dd9f-3df5-46c4-895c-65b6cd510c84 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:14.142507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ca0dd9f-3df5-46c4-895c-65b6cd510c84 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:14.176035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5313440-9fb7-4c3f-9ecf-78e5cc5a33dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:14.176876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313440-9fb7-4c3f-9ecf-78e5cc5a33dc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:14.177153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313440-9fb7-4c3f-9ecf-78e5cc5a33dc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:14.177448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5313440-9fb7-4c3f-9ecf-78e5cc5a33dc None admin] PATH_INFO: `/v3/projects/29bd1af3310745ee92593423857e7b3a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:14.178611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5313440-9fb7-4c3f-9ecf-78e5cc5a33dc None admin] RBAC: Authorizing `identity:get_project(project_id=29bd1af3310745ee92593423857e7b3a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:14.180032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5313440-9fb7-4c3f-9ecf-78e5cc5a33dc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:14.181750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 558/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:14 2022] GET /identity/v3/projects/29bd1af3310745ee92593423857e7b3a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:14.188544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58d768-8954-43af-a1ca-e1f2d7617be6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:14.282289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b58d768-8954-43af-a1ca-e1f2d7617be6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:14.314830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408bbae9-4809-45bb-be5c-ddd74f731dfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:14.315472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bbae9-4809-45bb-be5c-ddd74f731dfc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:14.315743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bbae9-4809-45bb-be5c-ddd74f731dfc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:14.316011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408bbae9-4809-45bb-be5c-ddd74f731dfc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:14.316830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bbae9-4809-45bb-be5c-ddd74f731dfc None admin] RBAC: Adding query filter params (role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=29bd1af3310745ee92593423857e7b3a, user.id=07b5e91af46d4372bc76388e7db89562) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:14.317135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bbae9-4809-45bb-be5c-ddd74f731dfc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:14.318573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-408bbae9-4809-45bb-be5c-ddd74f731dfc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:14.321349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:14.325321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 559/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:14 2022] GET /identity/v3/role_assignments?user.id=07b5e91af46d4372bc76388e7db89562&scope.project.id=29bd1af3310745ee92593423857e7b3a&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 259 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:16.313320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb64b55-fbd6-4489-bb25-94814d898706 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:16.313916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb64b55-fbd6-4489-bb25-94814d898706 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:16.313916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccb64b55-fbd6-4489-bb25-94814d898706 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:16.315273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 559/1118] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:16.320610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a035a-68b2-4eda-afd1-25e93cd12815 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:16.321049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a035a-68b2-4eda-afd1-25e93cd12815 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:16.321152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d1a035a-68b2-4eda-afd1-25e93cd12815 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:16.337924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3d1a035a-68b2-4eda-afd1-25e93cd12815 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:16.339087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3d1a035a-68b2-4eda-afd1-25e93cd12815 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:16.403290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 560/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:16.426383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb64b55-fbd6-4489-bb25-94814d898706 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:16.468660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:16.532403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccb64b55-fbd6-4489-bb25-94814d898706 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:16.564515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa72220-9434-4c43-884a-3887db665c14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:16.565295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72220-9434-4c43-884a-3887db665c14 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:16.565604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72220-9434-4c43-884a-3887db665c14 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:16.565874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa72220-9434-4c43-884a-3887db665c14 None admin] PATH_INFO: `/v3/roles/dd9d89d3dbf5451ba6661a3634837e37` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:16.567303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa72220-9434-4c43-884a-3887db665c14 None admin] RBAC: Authorizing `identity:get_role(role_id=dd9d89d3dbf5451ba6661a3634837e37)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:16.568645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa72220-9434-4c43-884a-3887db665c14 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:16.570039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 560/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:16 2022] GET /identity/v3/roles/dd9d89d3dbf5451ba6661a3634837e37 => generated 223 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:16.576334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a035a-68b2-4eda-afd1-25e93cd12815 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:16.670716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d1a035a-68b2-4eda-afd1-25e93cd12815 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:16.697812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:16.704283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945392e1-988f-4f1f-a401-daa12b901274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:16.705137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945392e1-988f-4f1f-a401-daa12b901274 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:16.705428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945392e1-988f-4f1f-a401-daa12b901274 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:16.705708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945392e1-988f-4f1f-a401-daa12b901274 None admin] PATH_INFO: `/v3/users/07b5e91af46d4372bc76388e7db89562` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:16.706861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945392e1-988f-4f1f-a401-daa12b901274 None admin] RBAC: Authorizing `identity:get_user(user_id=07b5e91af46d4372bc76388e7db89562)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:16.708267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945392e1-988f-4f1f-a401-daa12b901274 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:16.709886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 561/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:16 2022] GET /identity/v3/users/07b5e91af46d4372bc76388e7db89562 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:16.716754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa72220-9434-4c43-884a-3887db665c14 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:16.815374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa72220-9434-4c43-884a-3887db665c14 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:16.822820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:16.849352 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f368e62-22c8-4666-9689-e1896c2d1d7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:16.850227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368e62-22c8-4666-9689-e1896c2d1d7c None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:16.850504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368e62-22c8-4666-9689-e1896c2d1d7c None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:16.850775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f368e62-22c8-4666-9689-e1896c2d1d7c None admin] PATH_INFO: `/v3/projects/29bd1af3310745ee92593423857e7b3a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:16.851923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f368e62-22c8-4666-9689-e1896c2d1d7c None admin] RBAC: Authorizing `identity:get_project(project_id=29bd1af3310745ee92593423857e7b3a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:16.853348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f368e62-22c8-4666-9689-e1896c2d1d7c None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:16.855788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 561/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:16 2022] GET /identity/v3/projects/29bd1af3310745ee92593423857e7b3a => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:16.861848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945392e1-988f-4f1f-a401-daa12b901274 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:16.957676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945392e1-988f-4f1f-a401-daa12b901274 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:16.990131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7985ee3a-6687-4c5c-9e87-8adbe16708da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:16.990994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985ee3a-6687-4c5c-9e87-8adbe16708da None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:16.991271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985ee3a-6687-4c5c-9e87-8adbe16708da None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:16.991542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7985ee3a-6687-4c5c-9e87-8adbe16708da None admin] PATH_INFO: `/v3/projects/29bd1af3310745ee92593423857e7b3a/users/07b5e91af46d4372bc76388e7db89562/roles/dd9d89d3dbf5451ba6661a3634837e37` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:16.993707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985ee3a-6687-4c5c-9e87-8adbe16708da None admin] RBAC: Authorizing `identity:create_grant(project_id=29bd1af3310745ee92593423857e7b3a, user_id=07b5e91af46d4372bc76388e7db89562, role_id=dd9d89d3dbf5451ba6661a3634837e37)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:16.995113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7985ee3a-6687-4c5c-9e87-8adbe16708da None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:17.007855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 562/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:25:16 2022] PUT /identity/v3/projects/29bd1af3310745ee92593423857e7b3a/users/07b5e91af46d4372bc76388e7db89562/roles/dd9d89d3dbf5451ba6661a3634837e37 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:25:19.011560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67129-aba9-49cc-ae08-dd9d87337737 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:19.012112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67129-aba9-49cc-ae08-dd9d87337737 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:19.012112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d67129-aba9-49cc-ae08-dd9d87337737 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:19.013575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 562/1124] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:19.018575 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36ce9-20ec-4afa-8a7c-9dd4e806e17b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:19.018993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36ce9-20ec-4afa-8a7c-9dd4e806e17b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:19.019127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb36ce9-20ec-4afa-8a7c-9dd4e806e17b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:19.036421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-edb36ce9-20ec-4afa-8a7c-9dd4e806e17b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:19.037633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-edb36ce9-20ec-4afa-8a7c-9dd4e806e17b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:19.090541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:19.104182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 563/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:19 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:19.128387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d67129-aba9-49cc-ae08-dd9d87337737 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:19.227422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d67129-aba9-49cc-ae08-dd9d87337737 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:19.259747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26223-b31a-41c2-b5c5-3c195edcffbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:19.260579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26223-b31a-41c2-b5c5-3c195edcffbe None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:19.260852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26223-b31a-41c2-b5c5-3c195edcffbe None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:19.261846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c26223-b31a-41c2-b5c5-3c195edcffbe None admin] PATH_INFO: `/v3/roles/dd9d89d3dbf5451ba6661a3634837e37` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:19.263204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c26223-b31a-41c2-b5c5-3c195edcffbe None admin] RBAC: Authorizing `identity:get_role(role_id=dd9d89d3dbf5451ba6661a3634837e37)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:19.264547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c26223-b31a-41c2-b5c5-3c195edcffbe None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:19.265917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 563/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:19 2022] GET /identity/v3/roles/dd9d89d3dbf5451ba6661a3634837e37 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:19.271674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb36ce9-20ec-4afa-8a7c-9dd4e806e17b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:19.365888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb36ce9-20ec-4afa-8a7c-9dd4e806e17b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:19.397938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d5639-c830-461d-b4f8-f6df4d1b7fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:19.398780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5639-c830-461d-b4f8-f6df4d1b7fdb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:19.399051 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5639-c830-461d-b4f8-f6df4d1b7fdb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:19.399317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4d5639-c830-461d-b4f8-f6df4d1b7fdb None admin] PATH_INFO: `/v3/users/07b5e91af46d4372bc76388e7db89562` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:19.400735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5639-c830-461d-b4f8-f6df4d1b7fdb None admin] RBAC: Authorizing `identity:get_user(user_id=07b5e91af46d4372bc76388e7db89562)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:19.402865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4d5639-c830-461d-b4f8-f6df4d1b7fdb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:19.404444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 564/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:19 2022] GET /identity/v3/users/07b5e91af46d4372bc76388e7db89562 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:19.410125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26223-b31a-41c2-b5c5-3c195edcffbe None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:19.453005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:19.508636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c26223-b31a-41c2-b5c5-3c195edcffbe None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:19.542910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca833abc-ac03-4ae8-8136-dbf352b5729f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:19.543534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833abc-ac03-4ae8-8136-dbf352b5729f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:19.543814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833abc-ac03-4ae8-8136-dbf352b5729f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:19.544089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca833abc-ac03-4ae8-8136-dbf352b5729f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:19.607767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca833abc-ac03-4ae8-8136-dbf352b5729f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:19.609196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca833abc-ac03-4ae8-8136-dbf352b5729f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:19.649307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:19.704820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 564/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:19.710739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d5639-c830-461d-b4f8-f6df4d1b7fdb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:19.768376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:19.812154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4d5639-c830-461d-b4f8-f6df4d1b7fdb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:19.844543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e62c87f-fc7c-487b-b17d-4be4b907977e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:19.845383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c87f-fc7c-487b-b17d-4be4b907977e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:19.845692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c87f-fc7c-487b-b17d-4be4b907977e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:19.845963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e62c87f-fc7c-487b-b17d-4be4b907977e None admin] PATH_INFO: `/v3/projects/29bd1af3310745ee92593423857e7b3a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:19.847120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62c87f-fc7c-487b-b17d-4be4b907977e None admin] RBAC: Authorizing `identity:get_project(project_id=29bd1af3310745ee92593423857e7b3a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:19.848537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e62c87f-fc7c-487b-b17d-4be4b907977e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:19.850236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 565/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:19 2022] GET /identity/v3/projects/29bd1af3310745ee92593423857e7b3a => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:19.856959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca833abc-ac03-4ae8-8136-dbf352b5729f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:19.952405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca833abc-ac03-4ae8-8136-dbf352b5729f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:19.985287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310d5c6d-a80d-4fa7-8ab7-55bd7f0120ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:19.985944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5c6d-a80d-4fa7-8ab7-55bd7f0120ff None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:19.986224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5c6d-a80d-4fa7-8ab7-55bd7f0120ff None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:19.986497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310d5c6d-a80d-4fa7-8ab7-55bd7f0120ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:19.987311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5c6d-a80d-4fa7-8ab7-55bd7f0120ff None admin] RBAC: Adding query filter params (role.id=dd9d89d3dbf5451ba6661a3634837e37, scope.project.id=29bd1af3310745ee92593423857e7b3a, user.id=07b5e91af46d4372bc76388e7db89562) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:19.987615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5c6d-a80d-4fa7-8ab7-55bd7f0120ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:19.989018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310d5c6d-a80d-4fa7-8ab7-55bd7f0120ff None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:19.994640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 565/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:19 2022] GET /identity/v3/role_assignments?user.id=07b5e91af46d4372bc76388e7db89562&scope.project.id=29bd1af3310745ee92593423857e7b3a&role.id=dd9d89d3dbf5451ba6661a3634837e37 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:22.105023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd2d9-acf7-4bd0-9d62-fe603de8316f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:22.105641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd2d9-acf7-4bd0-9d62-fe603de8316f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:22.105931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bbd2d9-acf7-4bd0-9d62-fe603de8316f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:22.107307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 566/1131] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:22.112392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9c49-dd57-4dc2-b3c4-d16b20f69275 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:22.112755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9c49-dd57-4dc2-b3c4-d16b20f69275 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:22.112952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853a9c49-dd57-4dc2-b3c4-d16b20f69275 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:22.125568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:22.131006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-853a9c49-dd57-4dc2-b3c4-d16b20f69275 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:22.132529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-853a9c49-dd57-4dc2-b3c4-d16b20f69275 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:22.200632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 566/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:22 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:22.224450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbd2d9-acf7-4bd0-9d62-fe603de8316f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:22.322757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62bbd2d9-acf7-4bd0-9d62-fe603de8316f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:22.344761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:22.355850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de650de-0c66-4459-ab80-43ce9b2e14da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:22.356553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de650de-0c66-4459-ab80-43ce9b2e14da None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:22.356831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de650de-0c66-4459-ab80-43ce9b2e14da None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:22.357101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de650de-0c66-4459-ab80-43ce9b2e14da None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:22.358280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de650de-0c66-4459-ab80-43ce9b2e14da None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:22.359697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de650de-0c66-4459-ab80-43ce9b2e14da None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:22.361268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 567/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:22 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:22.367028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a9c49-dd57-4dc2-b3c4-d16b20f69275 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:22.463352 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853a9c49-dd57-4dc2-b3c4-d16b20f69275 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:22.497044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d5add7-3148-42db-a569-1f1802e9bda7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:22.497713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5add7-3148-42db-a569-1f1802e9bda7 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:22.497993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5add7-3148-42db-a569-1f1802e9bda7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:22.498264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d5add7-3148-42db-a569-1f1802e9bda7 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:22.498958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5add7-3148-42db-a569-1f1802e9bda7 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:22.500374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d5add7-3148-42db-a569-1f1802e9bda7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:22.504269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:22.526729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 567/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:25:22 2022] POST /identity/v3/projects => generated 311 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:25:24.557028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6ed2-1694-4523-a5b5-f87d6320e98f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:24.557615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6ed2-1694-4523-a5b5-f87d6320e98f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:24.557615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bf6ed2-1694-4523-a5b5-f87d6320e98f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:24.558950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 568/1135] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:24.564616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b95c7-ba83-4d46-885c-b7b59a3a0b61 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:24.565043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b95c7-ba83-4d46-885c-b7b59a3a0b61 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:24.565191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-191b95c7-ba83-4d46-885c-b7b59a3a0b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:24.581663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-191b95c7-ba83-4d46-885c-b7b59a3a0b61 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:24.582838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-191b95c7-ba83-4d46-885c-b7b59a3a0b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:24.647010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 568/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:24 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:24.672065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf6ed2-1694-4523-a5b5-f87d6320e98f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:24.772846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bf6ed2-1694-4523-a5b5-f87d6320e98f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:24.806866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5795f9-6a7e-4c1d-a4a0-160553265d89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:24.807634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5795f9-6a7e-4c1d-a4a0-160553265d89 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:24.808477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5795f9-6a7e-4c1d-a4a0-160553265d89 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:24.808756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5795f9-6a7e-4c1d-a4a0-160553265d89 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:24.809953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5795f9-6a7e-4c1d-a4a0-160553265d89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:24.811378 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5795f9-6a7e-4c1d-a4a0-160553265d89 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:24.812955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 569/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:25:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:24.818582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b95c7-ba83-4d46-885c-b7b59a3a0b61 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:24.913722 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-191b95c7-ba83-4d46-885c-b7b59a3a0b61 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:24.929964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:24.947864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48179de1-2693-41d1-82d2-acef7fd7bad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:24.949330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48179de1-2693-41d1-82d2-acef7fd7bad1 None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:24.949636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48179de1-2693-41d1-82d2-acef7fd7bad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:24.949972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48179de1-2693-41d1-82d2-acef7fd7bad1 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:24.950669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48179de1-2693-41d1-82d2-acef7fd7bad1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:24.952219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48179de1-2693-41d1-82d2-acef7fd7bad1 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:24.971240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 569/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:25:24 2022] POST /identity/v3/users => generated 286 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:25:27.040458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93962-f791-42fd-a830-51c372d90182 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:27.040984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93962-f791-42fd-a830-51c372d90182 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:27.040984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d93962-f791-42fd-a830-51c372d90182 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:27.042399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 570/1139] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:27.047428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2d7a9-b377-4f6d-bede-d138174d7913 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:27.047837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2d7a9-b377-4f6d-bede-d138174d7913 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:27.047977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35a2d7a9-b377-4f6d-bede-d138174d7913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:27.064441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-35a2d7a9-b377-4f6d-bede-d138174d7913 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:27.065652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-35a2d7a9-b377-4f6d-bede-d138174d7913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:27.131754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 570/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:27.156362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93962-f791-42fd-a830-51c372d90182 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:27.213974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:27.252936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d93962-f791-42fd-a830-51c372d90182 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:27.285152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbd70-0d1e-4272-baa5-6c2e1e7c78df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:27.286069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbd70-0d1e-4272-baa5-6c2e1e7c78df None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:27.287346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbd70-0d1e-4272-baa5-6c2e1e7c78df None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:27.287346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44bbd70-0d1e-4272-baa5-6c2e1e7c78df None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:27.296586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44bbd70-0d1e-4272-baa5-6c2e1e7c78df None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d44bbd70-0d1e-4272-baa5-6c2e1e7c78df None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:27.304030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:27.305208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:27.306393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 571/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:27.311697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2d7a9-b377-4f6d-bede-d138174d7913 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:27.405857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35a2d7a9-b377-4f6d-bede-d138174d7913 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:27.408077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:27.441329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea567570-1b79-4269-a168-725381447955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:27.442012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea567570-1b79-4269-a168-725381447955 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:27.442289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea567570-1b79-4269-a168-725381447955 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:27.442559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea567570-1b79-4269-a168-725381447955 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:27.443292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea567570-1b79-4269-a168-725381447955 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:27.443591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea567570-1b79-4269-a168-725381447955 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:27.444940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea567570-1b79-4269-a168-725381447955 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:27.453558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 571/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:27.459325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbd70-0d1e-4272-baa5-6c2e1e7c78df None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:27.554424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44bbd70-0d1e-4272-baa5-6c2e1e7c78df None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:27.573210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:27.586829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b52b15-6103-4989-9aa9-5421f18d3518 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:27.587674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b52b15-6103-4989-9aa9-5421f18d3518 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:27.587950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b52b15-6103-4989-9aa9-5421f18d3518 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:27.588218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b52b15-6103-4989-9aa9-5421f18d3518 None admin] PATH_INFO: `/v3/users/d09d70333f9f43df877e4809d1f8e087` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:27.602056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b52b15-6103-4989-9aa9-5421f18d3518 None admin] RBAC: Authorizing `identity:get_user(user_id=d09d70333f9f43df877e4809d1f8e087)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:27.603479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45b52b15-6103-4989-9aa9-5421f18d3518 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:27.605685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 572/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:27 2022] GET /identity/v3/users/d09d70333f9f43df877e4809d1f8e087 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:27.611375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea567570-1b79-4269-a168-725381447955 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:27.708791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea567570-1b79-4269-a168-725381447955 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:27.741361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dcf17-5ad1-4c94-8e37-62e9f6ea06d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:27.742015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dcf17-5ad1-4c94-8e37-62e9f6ea06d2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:27.742293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dcf17-5ad1-4c94-8e37-62e9f6ea06d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:27.742565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-398dcf17-5ad1-4c94-8e37-62e9f6ea06d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:27.774591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:27.809259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dcf17-5ad1-4c94-8e37-62e9f6ea06d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:27.810661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-398dcf17-5ad1-4c94-8e37-62e9f6ea06d2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:27.905376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 572/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:27 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:27.911359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b52b15-6103-4989-9aa9-5421f18d3518 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:28.005213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45b52b15-6103-4989-9aa9-5421f18d3518 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:28.037545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb8a3077-6bbc-4fc4-86e6-09ed36d3faa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:28.038377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3077-6bbc-4fc4-86e6-09ed36d3faa4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:28.038653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3077-6bbc-4fc4-86e6-09ed36d3faa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:28.038919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8a3077-6bbc-4fc4-86e6-09ed36d3faa4 None admin] PATH_INFO: `/v3/projects/bc935837d2254f0595e34a0e192039ba` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:28.040063 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a3077-6bbc-4fc4-86e6-09ed36d3faa4 None admin] RBAC: Authorizing `identity:get_project(project_id=bc935837d2254f0595e34a0e192039ba)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:28.041490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb8a3077-6bbc-4fc4-86e6-09ed36d3faa4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:28.043828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 573/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:27 2022] GET /identity/v3/projects/bc935837d2254f0595e34a0e192039ba => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:28.049898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dcf17-5ad1-4c94-8e37-62e9f6ea06d2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:28.112957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:28.146571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-398dcf17-5ad1-4c94-8e37-62e9f6ea06d2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:28.179740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d834ed1b-8fc1-43c2-89ff-c4699b73ebc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:28.180369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ed1b-8fc1-43c2-89ff-c4699b73ebc7 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:28.180646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ed1b-8fc1-43c2-89ff-c4699b73ebc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:28.180921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d834ed1b-8fc1-43c2-89ff-c4699b73ebc7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:28.181766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834ed1b-8fc1-43c2-89ff-c4699b73ebc7 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=bc935837d2254f0595e34a0e192039ba, user.id=d09d70333f9f43df877e4809d1f8e087) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:28.182076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834ed1b-8fc1-43c2-89ff-c4699b73ebc7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:28.184024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d834ed1b-8fc1-43c2-89ff-c4699b73ebc7 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:28.189236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 573/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:28 2022] GET /identity/v3/role_assignments?user.id=d09d70333f9f43df877e4809d1f8e087&scope.project.id=bc935837d2254f0595e34a0e192039ba&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:30.187980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb45c-b71a-4e28-82d5-2998a4e00845 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:30.188507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb45c-b71a-4e28-82d5-2998a4e00845 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:30.188507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deb45c-b71a-4e28-82d5-2998a4e00845 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:30.189913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 574/1147] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:30.195213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10e78-b165-4f73-8fd3-f760046b372b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:30.195596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10e78-b165-4f73-8fd3-f760046b372b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:30.195755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a10e78-b165-4f73-8fd3-f760046b372b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:30.213109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-43a10e78-b165-4f73-8fd3-f760046b372b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:30.214366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-43a10e78-b165-4f73-8fd3-f760046b372b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:30.278051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 574/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:30.300105 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deb45c-b71a-4e28-82d5-2998a4e00845 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:30.346272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:30.397943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deb45c-b71a-4e28-82d5-2998a4e00845 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:30.433409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e820f81-985f-4d2d-8be5-785663c5b87d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:30.434220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e820f81-985f-4d2d-8be5-785663c5b87d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:30.434497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e820f81-985f-4d2d-8be5-785663c5b87d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:30.434768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e820f81-985f-4d2d-8be5-785663c5b87d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:30.444781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e820f81-985f-4d2d-8be5-785663c5b87d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5e820f81-985f-4d2d-8be5-785663c5b87d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:30.452344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:30.453478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:30.454386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 575/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:30.459905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a10e78-b165-4f73-8fd3-f760046b372b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:30.516611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:30.555697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a10e78-b165-4f73-8fd3-f760046b372b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:30.590018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:30.590671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:30.590949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:30.591223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:30.591959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:30.592260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:30.593624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:30.601315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 575/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:30.607169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e820f81-985f-4d2d-8be5-785663c5b87d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:30.704143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e820f81-985f-4d2d-8be5-785663c5b87d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:30.710541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:30.736799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd162f-f1df-4ebf-832f-a52208fe7462 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:30.737675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd162f-f1df-4ebf-832f-a52208fe7462 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:30.737951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd162f-f1df-4ebf-832f-a52208fe7462 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:30.738218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fd162f-f1df-4ebf-832f-a52208fe7462 None admin] PATH_INFO: `/v3/users/d09d70333f9f43df877e4809d1f8e087` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:30.739366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd162f-f1df-4ebf-832f-a52208fe7462 None admin] RBAC: Authorizing `identity:get_user(user_id=d09d70333f9f43df877e4809d1f8e087)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:30.740784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fd162f-f1df-4ebf-832f-a52208fe7462 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:30.742409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 576/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:30 2022] GET /identity/v3/users/d09d70333f9f43df877e4809d1f8e087 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:30.748307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:30.844813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e11ee6c-7004-4570-a42a-1b7c6bf8b17f None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:30.866281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:30.878356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d56f2c-9d5c-404e-bcac-3ecfefa9b3e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:30.879192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d56f2c-9d5c-404e-bcac-3ecfefa9b3e5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:30.879466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d56f2c-9d5c-404e-bcac-3ecfefa9b3e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:30.879732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d56f2c-9d5c-404e-bcac-3ecfefa9b3e5 None admin] PATH_INFO: `/v3/projects/bc935837d2254f0595e34a0e192039ba` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:30.880878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d56f2c-9d5c-404e-bcac-3ecfefa9b3e5 None admin] RBAC: Authorizing `identity:get_project(project_id=bc935837d2254f0595e34a0e192039ba)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:30.882312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d56f2c-9d5c-404e-bcac-3ecfefa9b3e5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:30.883974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 576/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:30 2022] GET /identity/v3/projects/bc935837d2254f0595e34a0e192039ba => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:30.889910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd162f-f1df-4ebf-832f-a52208fe7462 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:30.986312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fd162f-f1df-4ebf-832f-a52208fe7462 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:31.017653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4fe66a-1f43-4d95-8b26-f2087a26fcce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:31.018516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe66a-1f43-4d95-8b26-f2087a26fcce None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:31.018794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe66a-1f43-4d95-8b26-f2087a26fcce None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:31.019065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4fe66a-1f43-4d95-8b26-f2087a26fcce None admin] PATH_INFO: `/v3/projects/bc935837d2254f0595e34a0e192039ba/users/d09d70333f9f43df877e4809d1f8e087/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:31.020969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fe66a-1f43-4d95-8b26-f2087a26fcce None admin] RBAC: Authorizing `identity:create_grant(project_id=bc935837d2254f0595e34a0e192039ba, user_id=d09d70333f9f43df877e4809d1f8e087, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:31.022407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4fe66a-1f43-4d95-8b26-f2087a26fcce None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:31.036252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 577/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:25:30 2022] PUT /identity/v3/projects/bc935837d2254f0595e34a0e192039ba/users/d09d70333f9f43df877e4809d1f8e087/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:25:33.037018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceaa74-4f46-4d1a-a1b7-167014bbbe14 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:33.037669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceaa74-4f46-4d1a-a1b7-167014bbbe14 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:33.037669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2ceaa74-4f46-4d1a-a1b7-167014bbbe14 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:33.038958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 577/1154] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:33.044656 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eed01-5e05-45f3-9e8f-0b0c0f962c94 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:33.045057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eed01-5e05-45f3-9e8f-0b0c0f962c94 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:33.045213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e60eed01-5e05-45f3-9e8f-0b0c0f962c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:33.062037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e60eed01-5e05-45f3-9e8f-0b0c0f962c94 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:33.063214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e60eed01-5e05-45f3-9e8f-0b0c0f962c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:33.088823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:33.129424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 578/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:33.153780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceaa74-4f46-4d1a-a1b7-167014bbbe14 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:33.251564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2ceaa74-4f46-4d1a-a1b7-167014bbbe14 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:33.284658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec04ba-fcae-43ce-bdb3-02c3e9ffc9e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:33.285449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec04ba-fcae-43ce-bdb3-02c3e9ffc9e4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:33.285733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec04ba-fcae-43ce-bdb3-02c3e9ffc9e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:33.286007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ec04ba-fcae-43ce-bdb3-02c3e9ffc9e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:33.296518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ec04ba-fcae-43ce-bdb3-02c3e9ffc9e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-10ec04ba-fcae-43ce-bdb3-02c3e9ffc9e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:33.304013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:33.304932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:33.305864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 578/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:33.311311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eed01-5e05-45f3-9e8f-0b0c0f962c94 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:33.408878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e60eed01-5e05-45f3-9e8f-0b0c0f962c94 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:33.443173 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:33.443831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:33.444113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:33.444388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:33.445132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:33.445463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:33.446822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:33.454673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 579/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:33 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:33.460298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec04ba-fcae-43ce-bdb3-02c3e9ffc9e4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:33.508838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:33.557154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ec04ba-fcae-43ce-bdb3-02c3e9ffc9e4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:33.589220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8b75f-c46f-4cae-a3fd-cdf1760358ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:33.590093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8b75f-c46f-4cae-a3fd-cdf1760358ca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:33.590376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8b75f-c46f-4cae-a3fd-cdf1760358ca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:33.590648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e8b75f-c46f-4cae-a3fd-cdf1760358ca None admin] PATH_INFO: `/v3/users/d09d70333f9f43df877e4809d1f8e087` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:33.591805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8b75f-c46f-4cae-a3fd-cdf1760358ca None admin] RBAC: Authorizing `identity:get_user(user_id=d09d70333f9f43df877e4809d1f8e087)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:33.593220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e8b75f-c46f-4cae-a3fd-cdf1760358ca None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:33.594838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 579/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:33 2022] GET /identity/v3/users/d09d70333f9f43df877e4809d1f8e087 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:33.600531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:33.628504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:33.697806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72581501-9e49-48a9-b0e7-1f399bd0fa74 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:33.730049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a78f8c-48b1-4142-b8ad-050a4f7943da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:33.730681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a78f8c-48b1-4142-b8ad-050a4f7943da None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:33.730959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a78f8c-48b1-4142-b8ad-050a4f7943da None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:33.731231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a78f8c-48b1-4142-b8ad-050a4f7943da None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:33.796379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a78f8c-48b1-4142-b8ad-050a4f7943da None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:33.797846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a78f8c-48b1-4142-b8ad-050a4f7943da None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:33.822747 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:33.892389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 580/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:33.898328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8b75f-c46f-4cae-a3fd-cdf1760358ca None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:33.995186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e8b75f-c46f-4cae-a3fd-cdf1760358ca None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:34.010990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:34.028011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5440b378-579e-4230-9f49-0ceb97b40a4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:34.028843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b378-579e-4230-9f49-0ceb97b40a4d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:34.029119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b378-579e-4230-9f49-0ceb97b40a4d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:34.029388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5440b378-579e-4230-9f49-0ceb97b40a4d None admin] PATH_INFO: `/v3/projects/bc935837d2254f0595e34a0e192039ba` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:34.030564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440b378-579e-4230-9f49-0ceb97b40a4d None admin] RBAC: Authorizing `identity:get_project(project_id=bc935837d2254f0595e34a0e192039ba)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:34.031975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5440b378-579e-4230-9f49-0ceb97b40a4d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:34.033679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 580/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:33 2022] GET /identity/v3/projects/bc935837d2254f0595e34a0e192039ba => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:34.039597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a78f8c-48b1-4142-b8ad-050a4f7943da None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:34.134814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a78f8c-48b1-4142-b8ad-050a4f7943da None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:34.159843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:34.169277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56fa57c-e257-4792-9a2c-b2f889251b29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:34.169953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa57c-e257-4792-9a2c-b2f889251b29 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:34.170233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa57c-e257-4792-9a2c-b2f889251b29 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:34.170504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56fa57c-e257-4792-9a2c-b2f889251b29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:34.171330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fa57c-e257-4792-9a2c-b2f889251b29 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=bc935837d2254f0595e34a0e192039ba, user.id=d09d70333f9f43df877e4809d1f8e087) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:34.171661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fa57c-e257-4792-9a2c-b2f889251b29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:34.173071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56fa57c-e257-4792-9a2c-b2f889251b29 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:34.178690 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 581/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:34 2022] GET /identity/v3/role_assignments?user.id=d09d70333f9f43df877e4809d1f8e087&scope.project.id=bc935837d2254f0595e34a0e192039ba&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 608 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:36.216032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ae57a-cb47-4c7c-9c08-20b1d28e65a2 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:36.216566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ae57a-cb47-4c7c-9c08-20b1d28e65a2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:36.216566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6ae57a-cb47-4c7c-9c08-20b1d28e65a2 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:36.217980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 581/1162] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:36.223061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1dd04-3041-4341-a06b-3e8b1417cd03 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:36.223426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1dd04-3041-4341-a06b-3e8b1417cd03 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:36.223629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b1dd04-3041-4341-a06b-3e8b1417cd03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:36.240756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-99b1dd04-3041-4341-a06b-3e8b1417cd03 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:36.241977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-99b1dd04-3041-4341-a06b-3e8b1417cd03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:36.305911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 582/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:36.328841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ae57a-cb47-4c7c-9c08-20b1d28e65a2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:36.431779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6ae57a-cb47-4c7c-9c08-20b1d28e65a2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:36.466523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad37719-d236-42c5-8aa0-8daca2b08917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:36.467089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad37719-d236-42c5-8aa0-8daca2b08917 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:36.467369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad37719-d236-42c5-8aa0-8daca2b08917 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:36.467644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bad37719-d236-42c5-8aa0-8daca2b08917 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:36.521020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:36.535606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad37719-d236-42c5-8aa0-8daca2b08917 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:36.537050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bad37719-d236-42c5-8aa0-8daca2b08917 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:36.632199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 582/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:36.638705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1dd04-3041-4341-a06b-3e8b1417cd03 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:36.733718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b1dd04-3041-4341-a06b-3e8b1417cd03 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:36.753528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:36.767604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7276d08-dbf3-4dc7-a465-ba2d6ea0cdfc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:36.768393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276d08-dbf3-4dc7-a465-ba2d6ea0cdfc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:36.768671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276d08-dbf3-4dc7-a465-ba2d6ea0cdfc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:36.768942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7276d08-dbf3-4dc7-a465-ba2d6ea0cdfc None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:36.775620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7276d08-dbf3-4dc7-a465-ba2d6ea0cdfc None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:36.777674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7276d08-dbf3-4dc7-a465-ba2d6ea0cdfc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-c7276d08-dbf3-4dc7-a465-ba2d6ea0cdfc None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:36.791538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:36.792751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:36.793646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 583/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:25:36 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:36.798629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad37719-d236-42c5-8aa0-8daca2b08917 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:36.879060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:36.894092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bad37719-d236-42c5-8aa0-8daca2b08917 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:36.927004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b79f03-b65e-4c1c-b527-e4c4b78878fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:36.927641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79f03-b65e-4c1c-b527-e4c4b78878fb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:36.927918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79f03-b65e-4c1c-b527-e4c4b78878fb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:36.928188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b79f03-b65e-4c1c-b527-e4c4b78878fb None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:36.928888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b79f03-b65e-4c1c-b527-e4c4b78878fb None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:36.929187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b79f03-b65e-4c1c-b527-e4c4b78878fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:36.930566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b79f03-b65e-4c1c-b527-e4c4b78878fb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:36.938168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 583/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Tue Jul 12 08:25:36 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:38.939731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ddb72-35e3-41bc-8dda-ec8ece3e80f2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:38.940259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ddb72-35e3-41bc-8dda-ec8ece3e80f2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:38.940259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2ddb72-35e3-41bc-8dda-ec8ece3e80f2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:38.941674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 584/1167] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:38.946785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e92e-055e-4d00-bf75-97937a291ac2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:38.947180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e92e-055e-4d00-bf75-97937a291ac2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:38.947328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f228e92e-055e-4d00-bf75-97937a291ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:38.964651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f228e92e-055e-4d00-bf75-97937a291ac2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:38.965862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f228e92e-055e-4d00-bf75-97937a291ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:39.030780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 584/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:39.053074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ddb72-35e3-41bc-8dda-ec8ece3e80f2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:39.158752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2ddb72-35e3-41bc-8dda-ec8ece3e80f2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:39.191463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffded6b3-3e12-4720-aa45-fc98511a2451 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:39.192055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded6b3-3e12-4720-aa45-fc98511a2451 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:39.192337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded6b3-3e12-4720-aa45-fc98511a2451 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:39.192613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffded6b3-3e12-4720-aa45-fc98511a2451 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:39.193356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffded6b3-3e12-4720-aa45-fc98511a2451 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:39.194750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffded6b3-3e12-4720-aa45-fc98511a2451 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:39.208974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 585/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Tue Jul 12 08:25:39 2022] POST /identity/v3/domains => generated 267 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:25:41.251278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b030-3b5a-43c4-9bd9-373cbcd30563 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:41.251807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b030-3b5a-43c4-9bd9-373cbcd30563 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:41.251807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b89b030-3b5a-43c4-9bd9-373cbcd30563 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:41.253200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 585/1170] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:41.258201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6510-3539-47ef-a5f9-d6021d125ab2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:41.258638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6510-3539-47ef-a5f9-d6021d125ab2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:41.258734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee9a6510-3539-47ef-a5f9-d6021d125ab2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:41.275013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ee9a6510-3539-47ef-a5f9-d6021d125ab2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:41.276563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ee9a6510-3539-47ef-a5f9-d6021d125ab2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:41.309851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:41.342555 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 586/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:41.365314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b030-3b5a-43c4-9bd9-373cbcd30563 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:41.446204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:41.466584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b89b030-3b5a-43c4-9bd9-373cbcd30563 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:41.498913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c72d8333-9415-4c5c-88fc-5b7da32bfa6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:41.499753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d8333-9415-4c5c-88fc-5b7da32bfa6f None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:41.500031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d8333-9415-4c5c-88fc-5b7da32bfa6f None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:41.500304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c72d8333-9415-4c5c-88fc-5b7da32bfa6f None admin] PATH_INFO: `/v3/domains/2223360ec4504a9794231f99c6702c6d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:41.510944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d8333-9415-4c5c-88fc-5b7da32bfa6f None admin] RBAC: Authorizing `identity:get_domain(domain_id=2223360ec4504a9794231f99c6702c6d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:41.513115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c72d8333-9415-4c5c-88fc-5b7da32bfa6f None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:41.514769 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 586/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Jul 12 08:25:41 2022] GET /identity/v3/domains/2223360ec4504a9794231f99c6702c6d => generated 267 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:41.520526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6510-3539-47ef-a5f9-d6021d125ab2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:41.614631 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee9a6510-3539-47ef-a5f9-d6021d125ab2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:41.648929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c10c3b6-0529-46ae-9131-a284a36b8ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:41.649602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c3b6-0529-46ae-9131-a284a36b8ffc None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:41.649884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c3b6-0529-46ae-9131-a284a36b8ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:41.650412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c10c3b6-0529-46ae-9131-a284a36b8ffc None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:41.651757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c3b6-0529-46ae-9131-a284a36b8ffc None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:41.653181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c10c3b6-0529-46ae-9131-a284a36b8ffc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:41.677400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 587/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:25:41 2022] POST /identity/v3/projects => generated 361 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:25:43.719348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df72a6-bb9c-4505-9173-daeeaba79a8c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:43.719866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df72a6-bb9c-4505-9173-daeeaba79a8c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:43.719866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3df72a6-bb9c-4505-9173-daeeaba79a8c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:43.721186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 587/1174] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:43.726459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05f47b-153d-4303-a2f1-8a6b2c0f60a4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:43.726859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05f47b-153d-4303-a2f1-8a6b2c0f60a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:43.727025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc05f47b-153d-4303-a2f1-8a6b2c0f60a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:43.744418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fc05f47b-153d-4303-a2f1-8a6b2c0f60a4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:43.746190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc05f47b-153d-4303-a2f1-8a6b2c0f60a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:43.762436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:43.813726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 588/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:43.839072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df72a6-bb9c-4505-9173-daeeaba79a8c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:43.938647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3df72a6-bb9c-4505-9173-daeeaba79a8c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:43.971251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e584732c-7364-4595-adab-ce4e4497f1a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:43.972033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584732c-7364-4595-adab-ce4e4497f1a3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:43.972305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584732c-7364-4595-adab-ce4e4497f1a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:43.972567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e584732c-7364-4595-adab-ce4e4497f1a3 None admin] PATH_INFO: `/v3/domains/2223360ec4504a9794231f99c6702c6d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:43.973737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584732c-7364-4595-adab-ce4e4497f1a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=2223360ec4504a9794231f99c6702c6d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:43.975151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e584732c-7364-4595-adab-ce4e4497f1a3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:43.976738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 588/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Tue Jul 12 08:25:43 2022] GET /identity/v3/domains/2223360ec4504a9794231f99c6702c6d => generated 267 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:43.983115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05f47b-153d-4303-a2f1-8a6b2c0f60a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:44.077845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc05f47b-153d-4303-a2f1-8a6b2c0f60a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:44.110119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd428fbc-1232-4f59-bd98-8118e0dddeb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:44.110767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd428fbc-1232-4f59-bd98-8118e0dddeb4 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:44.111046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd428fbc-1232-4f59-bd98-8118e0dddeb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:44.111319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd428fbc-1232-4f59-bd98-8118e0dddeb4 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:44.112017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd428fbc-1232-4f59-bd98-8118e0dddeb4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:44.113446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd428fbc-1232-4f59-bd98-8118e0dddeb4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:44.132141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 589/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:25:43 2022] POST /identity/v3/users => generated 311 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:25:46.179960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078649-c436-4de8-9e45-42e73b1d21f4 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:46.180604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078649-c436-4de8-9e45-42e73b1d21f4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:46.180604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b078649-c436-4de8-9e45-42e73b1d21f4 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:46.181905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 589/1178] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:46.187162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab32c60-b2c5-478f-b59d-3faf72500697 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:46.187551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab32c60-b2c5-478f-b59d-3faf72500697 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:46.187708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab32c60-b2c5-478f-b59d-3faf72500697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:46.203955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fab32c60-b2c5-478f-b59d-3faf72500697 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:46.205115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fab32c60-b2c5-478f-b59d-3faf72500697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:46.207041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:46.271467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 590/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:46 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:46.294989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b078649-c436-4de8-9e45-42e73b1d21f4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:46.305473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:46.391847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b078649-c436-4de8-9e45-42e73b1d21f4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:46.424504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2af654-9e35-482d-8aac-164b8130f2eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:46.425282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2af654-9e35-482d-8aac-164b8130f2eb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:46.425594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2af654-9e35-482d-8aac-164b8130f2eb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:46.425866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2af654-9e35-482d-8aac-164b8130f2eb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:46.435669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb2af654-9e35-482d-8aac-164b8130f2eb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-eb2af654-9e35-482d-8aac-164b8130f2eb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:46.443138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:46.444362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:46.445347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 590/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:46.450759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab32c60-b2c5-478f-b59d-3faf72500697 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:46.546124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab32c60-b2c5-478f-b59d-3faf72500697 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:46.578186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:46.578828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:46.579104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:46.579374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:46.580104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:46.580404 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:46.581771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:46.586470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:46.590846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 591/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:46 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:46.596367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2af654-9e35-482d-8aac-164b8130f2eb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:46.661234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:46.694780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2af654-9e35-482d-8aac-164b8130f2eb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:46.726766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821690c9-a2a7-4877-abac-295b8abe565b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:46.727617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821690c9-a2a7-4877-abac-295b8abe565b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:46.727892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821690c9-a2a7-4877-abac-295b8abe565b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:46.728160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-821690c9-a2a7-4877-abac-295b8abe565b None admin] PATH_INFO: `/v3/users/5ea3c9d112ee490e82144ee7569b3cfb` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:46.741285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821690c9-a2a7-4877-abac-295b8abe565b None admin] RBAC: Authorizing `identity:get_user(user_id=5ea3c9d112ee490e82144ee7569b3cfb)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:46.742744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-821690c9-a2a7-4877-abac-295b8abe565b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:46.744918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 591/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:46 2022] GET /identity/v3/users/5ea3c9d112ee490e82144ee7569b3cfb => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:46.750626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:46.850754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-450fde35-a527-45d7-9ee9-a29d5d9b404d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:46.882451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88abca-a1b4-4a6a-a331-27238d699e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:46.883075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88abca-a1b4-4a6a-a331-27238d699e7a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:46.883350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88abca-a1b4-4a6a-a331-27238d699e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:46.883617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c88abca-a1b4-4a6a-a331-27238d699e7a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:46.945915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:46.948111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88abca-a1b4-4a6a-a331-27238d699e7a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:46.949958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c88abca-a1b4-4a6a-a331-27238d699e7a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:47.043331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 592/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:46 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:47.049189 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821690c9-a2a7-4877-abac-295b8abe565b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:47.145576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-821690c9-a2a7-4877-abac-295b8abe565b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:47.171086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:47.179645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf0062a4-605d-4949-80b1-5c20326ccec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:47.180484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0062a4-605d-4949-80b1-5c20326ccec9 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:47.181032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0062a4-605d-4949-80b1-5c20326ccec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:47.181032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf0062a4-605d-4949-80b1-5c20326ccec9 None admin] PATH_INFO: `/v3/projects/7d7fb5ac127c46b6bac439f4a4df537c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:47.182400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0062a4-605d-4949-80b1-5c20326ccec9 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7fb5ac127c46b6bac439f4a4df537c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:47.183768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf0062a4-605d-4949-80b1-5c20326ccec9 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:47.185465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 592/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:47 2022] GET /identity/v3/projects/7d7fb5ac127c46b6bac439f4a4df537c => generated 361 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:47.191517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88abca-a1b4-4a6a-a331-27238d699e7a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:47.287380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:47.290642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c88abca-a1b4-4a6a-a331-27238d699e7a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:47.324121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6e85a-cf21-4f20-b49a-a6b48447baaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:47.324753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e85a-cf21-4f20-b49a-a6b48447baaa None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:47.325029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e85a-cf21-4f20-b49a-a6b48447baaa None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:47.325305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6e85a-cf21-4f20-b49a-a6b48447baaa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:47.326148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e85a-cf21-4f20-b49a-a6b48447baaa None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=7d7fb5ac127c46b6bac439f4a4df537c, user.id=5ea3c9d112ee490e82144ee7569b3cfb) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:47.326455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e85a-cf21-4f20-b49a-a6b48447baaa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:47.327857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6e85a-cf21-4f20-b49a-a6b48447baaa None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:47.333032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 593/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:47 2022] GET /identity/v3/role_assignments?user.id=5ea3c9d112ee490e82144ee7569b3cfb&scope.project.id=7d7fb5ac127c46b6bac439f4a4df537c&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 259 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:49.406241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c19dad-bf5e-46b3-8c07-368c47644561 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:49.406799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c19dad-bf5e-46b3-8c07-368c47644561 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:49.406799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c19dad-bf5e-46b3-8c07-368c47644561 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:49.408182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 593/1186] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:49.413483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ecd8-2d96-404c-af08-e5d988e3f21e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:49.413906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ecd8-2d96-404c-af08-e5d988e3f21e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:49.414033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2111ecd8-2d96-404c-af08-e5d988e3f21e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:49.430927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2111ecd8-2d96-404c-af08-e5d988e3f21e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:49.432732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2111ecd8-2d96-404c-af08-e5d988e3f21e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:49.497105 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 594/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:25:49.519199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c19dad-bf5e-46b3-8c07-368c47644561 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:49.617323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c19dad-bf5e-46b3-8c07-368c47644561 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:49.649376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca58cb-858c-4503-b7f3-93f830460a2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:49.650430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca58cb-858c-4503-b7f3-93f830460a2e None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:49.651284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca58cb-858c-4503-b7f3-93f830460a2e None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:49.651563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fca58cb-858c-4503-b7f3-93f830460a2e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:49.661349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fca58cb-858c-4503-b7f3-93f830460a2e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3fca58cb-858c-4503-b7f3-93f830460a2e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:49.669675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:49.670802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:25:49.671723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 594/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:49.677171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111ecd8-2d96-404c-af08-e5d988e3f21e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:49.766401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:49.773343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2111ecd8-2d96-404c-af08-e5d988e3f21e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:49.808020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:49.808674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:49.808955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:49.809229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:49.810006 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:49.810311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:49.811697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:49.819418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 595/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:49.825294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca58cb-858c-4503-b7f3-93f830460a2e None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:49.878993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:49.922118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fca58cb-858c-4503-b7f3-93f830460a2e None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:49.955955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac547d15-0759-4ac5-9498-06738bac7b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:49.956810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac547d15-0759-4ac5-9498-06738bac7b04 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:49.957089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac547d15-0759-4ac5-9498-06738bac7b04 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:49.957362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac547d15-0759-4ac5-9498-06738bac7b04 None admin] PATH_INFO: `/v3/users/5ea3c9d112ee490e82144ee7569b3cfb` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:49.958555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac547d15-0759-4ac5-9498-06738bac7b04 None admin] RBAC: Authorizing `identity:get_user(user_id=5ea3c9d112ee490e82144ee7569b3cfb)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:49.959982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac547d15-0759-4ac5-9498-06738bac7b04 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:49.961631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 595/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:49 2022] GET /identity/v3/users/5ea3c9d112ee490e82144ee7569b3cfb => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:49.967536 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:50.063642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db91d04-2a7f-487c-88a6-22c244f53690 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:50.095168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a2758c5-e2b1-493a-a48c-41da43766362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:50.096008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2758c5-e2b1-493a-a48c-41da43766362 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:50.096283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2758c5-e2b1-493a-a48c-41da43766362 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:50.096547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a2758c5-e2b1-493a-a48c-41da43766362 None admin] PATH_INFO: `/v3/projects/7d7fb5ac127c46b6bac439f4a4df537c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:50.097728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2758c5-e2b1-493a-a48c-41da43766362 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7fb5ac127c46b6bac439f4a4df537c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:50.099135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a2758c5-e2b1-493a-a48c-41da43766362 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:50.100799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 596/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:49 2022] GET /identity/v3/projects/7d7fb5ac127c46b6bac439f4a4df537c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:50.107175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac547d15-0759-4ac5-9498-06738bac7b04 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:50.203270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac547d15-0759-4ac5-9498-06738bac7b04 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:50.224038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:50.235994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16775323-89e8-44d7-a4d2-e58f828d90b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:50.236863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775323-89e8-44d7-a4d2-e58f828d90b8 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:50.237142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775323-89e8-44d7-a4d2-e58f828d90b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:50.237433 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16775323-89e8-44d7-a4d2-e58f828d90b8 None admin] PATH_INFO: `/v3/projects/7d7fb5ac127c46b6bac439f4a4df537c/users/5ea3c9d112ee490e82144ee7569b3cfb/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:50.239371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16775323-89e8-44d7-a4d2-e58f828d90b8 None admin] RBAC: Authorizing `identity:create_grant(project_id=7d7fb5ac127c46b6bac439f4a4df537c, user_id=5ea3c9d112ee490e82144ee7569b3cfb, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:50.240788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16775323-89e8-44d7-a4d2-e58f828d90b8 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:50.253073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 596/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:25:50 2022] PUT /identity/v3/projects/7d7fb5ac127c46b6bac439f4a4df537c/users/5ea3c9d112ee490e82144ee7569b3cfb/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:25:52.287506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f8c0-855d-4e65-bdb8-2a450b9c34a4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:52.288065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f8c0-855d-4e65-bdb8-2a450b9c34a4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:52.288065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6855f8c0-855d-4e65-bdb8-2a450b9c34a4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:52.289391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 597/1193] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:25:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:25:52.295191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbfd7e-31e3-4d63-9c61-d40f319d2498 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:52.295566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbfd7e-31e3-4d63-9c61-d40f319d2498 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:52.295741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ffbfd7e-31e3-4d63-9c61-d40f319d2498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:52.312960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7ffbfd7e-31e3-4d63-9c61-d40f319d2498 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:25:52.314151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7ffbfd7e-31e3-4d63-9c61-d40f319d2498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:25:52.377843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 597/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:25:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 12 08:25:52.401074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f8c0-855d-4e65-bdb8-2a450b9c34a4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:52.426333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:52.500310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6855f8c0-855d-4e65-bdb8-2a450b9c34a4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:52.532148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081599-4661-4512-9c71-73dbe90aa2b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:52.532925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081599-4661-4512-9c71-73dbe90aa2b3 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:52.533203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081599-4661-4512-9c71-73dbe90aa2b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:52.533680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14081599-4661-4512-9c71-73dbe90aa2b3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:52.544399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14081599-4661-4512-9c71-73dbe90aa2b3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-14081599-4661-4512-9c71-73dbe90aa2b3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:25:52.551889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:25:52.553011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:25:52.554134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 598/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:25:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:25:52.559584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbfd7e-31e3-4d63-9c61-d40f319d2498 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:52.655546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ffbfd7e-31e3-4d63-9c61-d40f319d2498 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:52.669091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:52.690821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:52.691475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:52.691755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:52.692027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:52.692768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:52.693071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:52.694470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:52.702586 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 598/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:25:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:52.708240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081599-4661-4512-9c71-73dbe90aa2b3 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:52.788873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:52.805053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14081599-4661-4512-9c71-73dbe90aa2b3 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:52.836798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ea40-81d8-4786-89f7-ea31770333f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:52.837667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea40-81d8-4786-89f7-ea31770333f4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:52.838493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea40-81d8-4786-89f7-ea31770333f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:52.838762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d670ea40-81d8-4786-89f7-ea31770333f4 None admin] PATH_INFO: `/v3/users/5ea3c9d112ee490e82144ee7569b3cfb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:52.840017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670ea40-81d8-4786-89f7-ea31770333f4 None admin] RBAC: Authorizing `identity:get_user(user_id=5ea3c9d112ee490e82144ee7569b3cfb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:52.841435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d670ea40-81d8-4786-89f7-ea31770333f4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:52.843032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 599/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Tue Jul 12 08:25:52 2022] GET /identity/v3/users/5ea3c9d112ee490e82144ee7569b3cfb => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:52.848666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:52.945373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925735ba-dd70-43af-81a7-4d01da55d211 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:52.977570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1e961-5593-49a8-9f2b-ca5ed84a96d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:52.978200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e961-5593-49a8-9f2b-ca5ed84a96d2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:52.978542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e961-5593-49a8-9f2b-ca5ed84a96d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:52.979296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b1e961-5593-49a8-9f2b-ca5ed84a96d2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:53.019861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:53.044977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1e961-5593-49a8-9f2b-ca5ed84a96d2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:53.046442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b1e961-5593-49a8-9f2b-ca5ed84a96d2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:53.140748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 599/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:25:52 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:25:53.146528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ea40-81d8-4786-89f7-ea31770333f4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:53.243474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d670ea40-81d8-4786-89f7-ea31770333f4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:53.276549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fae49c81-be18-4490-a1c8-5dcf1d9d1887 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:53.277381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae49c81-be18-4490-a1c8-5dcf1d9d1887 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:53.277687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae49c81-be18-4490-a1c8-5dcf1d9d1887 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:53.277958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fae49c81-be18-4490-a1c8-5dcf1d9d1887 None admin] PATH_INFO: `/v3/projects/7d7fb5ac127c46b6bac439f4a4df537c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:53.279111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae49c81-be18-4490-a1c8-5dcf1d9d1887 None admin] RBAC: Authorizing `identity:get_project(project_id=7d7fb5ac127c46b6bac439f4a4df537c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:53.280521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fae49c81-be18-4490-a1c8-5dcf1d9d1887 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:53.282201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 600/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Tue Jul 12 08:25:53 2022] GET /identity/v3/projects/7d7fb5ac127c46b6bac439f4a4df537c => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:25:53.288182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1e961-5593-49a8-9f2b-ca5ed84a96d2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:25:53.358682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:25:53.383287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b1e961-5593-49a8-9f2b-ca5ed84a96d2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:25:53.415728 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d80584-3133-4c72-b046-4d79acfa745b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:25:53.416407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d80584-3133-4c72-b046-4d79acfa745b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:25:53.416679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d80584-3133-4c72-b046-4d79acfa745b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:25:53.416947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d80584-3133-4c72-b046-4d79acfa745b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:25:53.417798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d80584-3133-4c72-b046-4d79acfa745b None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=7d7fb5ac127c46b6bac439f4a4df537c, user.id=5ea3c9d112ee490e82144ee7569b3cfb) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:25:53.418105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d80584-3133-4c72-b046-4d79acfa745b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:25:53.419538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d80584-3133-4c72-b046-4d79acfa745b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:25:53.425361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 600/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:25:53 2022] GET /identity/v3/role_assignments?user.id=5ea3c9d112ee490e82144ee7569b3cfb&scope.project.id=7d7fb5ac127c46b6bac439f4a4df537c&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:03.271712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:03.422706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=31 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:48.839509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467ad5-78a7-4974-9397-60b0cf6261f7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:48.840258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467ad5-78a7-4974-9397-60b0cf6261f7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:48.840411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09467ad5-78a7-4974-9397-60b0cf6261f7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:48.844794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 601/1201] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:26:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:26:48.848976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816148d-cba2-4641-bf20-0e4f444f3bbb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:48.849576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816148d-cba2-4641-bf20-0e4f444f3bbb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:48.849576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816148d-cba2-4641-bf20-0e4f444f3bbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:48.868957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a816148d-cba2-4641-bf20-0e4f444f3bbb None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:26:48.870185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a816148d-cba2-4641-bf20-0e4f444f3bbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:26:48.951992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 601/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:26:48 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:26:48.979188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09467ad5-78a7-4974-9397-60b0cf6261f7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:49.124122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09467ad5-78a7-4974-9397-60b0cf6261f7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:49.174213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:49.175022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:49.175347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:49.175624 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:49.193119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:49.194766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:26:49.217585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:49.218682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:49.219823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:26:49.219823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:26:49.219823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:49.219823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:26:49.219823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 602/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:26:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:26:49.226099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816148d-cba2-4641-bf20-0e4f444f3bbb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:49.377210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a816148d-cba2-4641-bf20-0e4f444f3bbb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:49.428818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:49.437456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fdb2c83-0d5d-4c82-91cd-0aa71f278eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:49.438459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb2c83-0d5d-4c82-91cd-0aa71f278eec None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:49.438979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb2c83-0d5d-4c82-91cd-0aa71f278eec None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:49.439213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fdb2c83-0d5d-4c82-91cd-0aa71f278eec None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:49.440001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb2c83-0d5d-4c82-91cd-0aa71f278eec None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:49.440312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb2c83-0d5d-4c82-91cd-0aa71f278eec None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:49.441739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fdb2c83-0d5d-4c82-91cd-0aa71f278eec None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:49.468650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:49.471668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 602/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:26:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:49.539545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:49.592267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a63325a-ff04-4222-95cb-1089b72966b1 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:49.638023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3ff1b6-e3db-4e23-9389-e0168a1c9d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:49.638738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff1b6-e3db-4e23-9389-e0168a1c9d7b None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:49.639500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff1b6-e3db-4e23-9389-e0168a1c9d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:49.639785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3ff1b6-e3db-4e23-9389-e0168a1c9d7b None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:49.640497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ff1b6-e3db-4e23-9389-e0168a1c9d7b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:49.641988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3ff1b6-e3db-4e23-9389-e0168a1c9d7b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:49.677467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 603/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Tue Jul 12 08:26:49 2022] POST /identity/v3/users => generated 251 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:26:52.094812 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431c153-28b0-4188-b484-1dd648735544 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:52.095368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431c153-28b0-4188-b484-1dd648735544 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:52.095448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4431c153-28b0-4188-b484-1dd648735544 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:52.097041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 603/1206] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:26:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:26:52.103145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ba84-118b-46e1-8b29-e2e71c813403 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:52.103615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ba84-118b-46e1-8b29-e2e71c813403 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:52.103699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3780ba84-118b-46e1-8b29-e2e71c813403 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:52.122545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3780ba84-118b-46e1-8b29-e2e71c813403 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:26:52.123878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3780ba84-118b-46e1-8b29-e2e71c813403 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:26:52.202347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 604/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:26:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:26:52.226358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431c153-28b0-4188-b484-1dd648735544 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:52.340448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4431c153-28b0-4188-b484-1dd648735544 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:52.381350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975a5c2-558d-47f5-95c1-29af6610d30a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:52.383124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a5c2-558d-47f5-95c1-29af6610d30a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:52.383437 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a5c2-558d-47f5-95c1-29af6610d30a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:52.383679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d975a5c2-558d-47f5-95c1-29af6610d30a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:52.396401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d975a5c2-558d-47f5-95c1-29af6610d30a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d975a5c2-558d-47f5-95c1-29af6610d30a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:26:52.405879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:52.407438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:26:52.408655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:26:52.414927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780ba84-118b-46e1-8b29-e2e71c813403 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:52.417957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 604/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:26:52 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:26:52.466371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:52.537399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3780ba84-118b-46e1-8b29-e2e71c813403 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:52.575314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:52.576126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:52.576500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:52.576908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:52.577817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:52.578233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:52.579648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:52.588992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 605/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:26:52 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:52.594833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975a5c2-558d-47f5-95c1-29af6610d30a None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:52.658367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:52.717620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d975a5c2-558d-47f5-95c1-29af6610d30a None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:52.768908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:52.769772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:52.770051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:52.770319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:52.783285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:52.784748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:26:52.815398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:52.816418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:52.822972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:26:52.822972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:26:52.822972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:52.822972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:26:52.822972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 605/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:26:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 223 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:26:52.823271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:52.943342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:52.947144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-493f23b3-e037-4a2d-bcb7-16402861c255 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:52.986079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:52.986860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:52.987206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:52.987556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:52.988356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:52.988728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:52.990610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:53.005997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 606/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:26:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:53.011976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:53.131491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec793460-9a70-4ce5-b76a-7e2148c34fb5 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:53.134624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:53.171100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:53.172112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:53.172524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:53.172928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:53.181616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:53.183148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:26:53.199665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:53.200864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:26:53.202092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 606/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:26:53 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:26:53.206780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:53.332488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed21ed9a-e963-4d2b-881b-bad105dd5981 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:53.374410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:53.375315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:53.375636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:53.377123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:53.378006 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:53.378340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:53.380020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:53.409970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 607/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 12 08:26:53 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:53.412126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:53.533771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fa5c17a-956a-406b-87a1-2abeedeb1a84 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:53.572076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f1d5-0131-4a23-9d22-9b61bc69f9fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:53.572907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f1d5-0131-4a23-9d22-9b61bc69f9fa None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:53.573194 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f1d5-0131-4a23-9d22-9b61bc69f9fa None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:53.573559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc9f1d5-0131-4a23-9d22-9b61bc69f9fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:53.610642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:53.656209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9f1d5-0131-4a23-9d22-9b61bc69f9fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:53.657984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc9f1d5-0131-4a23-9d22-9b61bc69f9fa None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:53.778563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 607/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:26:53 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:26:53.784373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:53.804296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:53.905465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5563053-4e3b-41a8-a3f3-7ed6bcf2b249 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:53.943079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:53.943969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:53.944254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:53.944657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:53.959626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:53.961186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:26:53.983292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:53.984409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:53.985465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:26:53.985465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:26:53.985465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:53.985465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:26:53.985465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 608/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:26:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:26:53.990475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f1d5-0131-4a23-9d22-9b61bc69f9fa None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:54.062045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:54.107065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc9f1d5-0131-4a23-9d22-9b61bc69f9fa None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:54.149060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:54.150147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:54.150399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:54.150675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:54.151398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:54.151705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:54.153069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:54.171240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 608/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:26:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:26:54.173899 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:54.251995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:54.288248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7259f3-3092-4ece-81ce-41bddd72fa9b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:54.327456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:54.328156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:54.328455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:54.328729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:54.336736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:54.338475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:26:54.353750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:54.355136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:26:54.356050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 609/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:26:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:26:54.361214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:54.488041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b23e6b05-fd34-4706-93b6-d6e2f4a7b1dd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:54.513229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:54.527820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87520f49-659e-4fb5-ae6a-946e5a248798 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:54.528477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87520f49-659e-4fb5-ae6a-946e5a248798 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:54.528756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87520f49-659e-4fb5-ae6a-946e5a248798 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:54.529028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87520f49-659e-4fb5-ae6a-946e5a248798 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:54.529836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87520f49-659e-4fb5-ae6a-946e5a248798 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:54.530145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87520f49-659e-4fb5-ae6a-946e5a248798 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:54.531569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87520f49-659e-4fb5-ae6a-946e5a248798 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:54.547883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 609/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:26:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:54.554133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:54.674448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a59fd2a5-0c83-4a0f-b42e-7b95dd93cb6a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:54.706766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:54.716680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdd306f-9557-4838-89b4-4c8a3f62f6fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:54.716680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd306f-9557-4838-89b4-4c8a3f62f6fc None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:54.717026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd306f-9557-4838-89b4-4c8a3f62f6fc None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:54.717399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdd306f-9557-4838-89b4-4c8a3f62f6fc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:54.718401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd306f-9557-4838-89b4-4c8a3f62f6fc None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=94eb335ec8004aa493080367f844d730) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:54.718797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd306f-9557-4838-89b4-4c8a3f62f6fc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:54.720456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdd306f-9557-4838-89b4-4c8a3f62f6fc None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:54.728137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 610/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:26:54 2022] GET /identity/v3/role_assignments?user.id=94eb335ec8004aa493080367f844d730&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 259 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:56.937158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e44e49-210a-4ac4-ac42-89704ba56ec3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:56.937744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e44e49-210a-4ac4-ac42-89704ba56ec3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:56.937744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e44e49-210a-4ac4-ac42-89704ba56ec3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:56.939135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 610/1220] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:26:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:26:56.944377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb303-8aa8-467e-b25e-e85c39ba5cc7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:56.945341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb303-8aa8-467e-b25e-e85c39ba5cc7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:56.945588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb2eb303-8aa8-467e-b25e-e85c39ba5cc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:56.962465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eb2eb303-8aa8-467e-b25e-e85c39ba5cc7 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:26:56.963663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eb2eb303-8aa8-467e-b25e-e85c39ba5cc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:26:57.032975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 611/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:26:56 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:26:57.055909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e44e49-210a-4ac4-ac42-89704ba56ec3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:57.162730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e44e49-210a-4ac4-ac42-89704ba56ec3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:57.199029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d790483-7e38-41ac-a7b2-62adb95c5d7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:57.199758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d790483-7e38-41ac-a7b2-62adb95c5d7b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:57.200037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d790483-7e38-41ac-a7b2-62adb95c5d7b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:57.200306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d790483-7e38-41ac-a7b2-62adb95c5d7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:57.210746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d790483-7e38-41ac-a7b2-62adb95c5d7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-1d790483-7e38-41ac-a7b2-62adb95c5d7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:26:57.218368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:57.219523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:26:57.220806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 611/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:26:57 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:26:57.225676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2eb303-8aa8-467e-b25e-e85c39ba5cc7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:57.328175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb2eb303-8aa8-467e-b25e-e85c39ba5cc7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:57.351674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:57.363280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:57.363944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:57.364228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:57.364504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:57.365247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] RBAC: Adding query filter params (name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:57.365590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:57.367102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:57.375253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 612/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:26:57 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:57.381490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d790483-7e38-41ac-a7b2-62adb95c5d7b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:57.427136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:57.489908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d790483-7e38-41ac-a7b2-62adb95c5d7b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:57.526695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:57.527455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:57.527728 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:57.528000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:57.538042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:57.540133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:26:57.557686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:57.558798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:57.559859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:26:57.559859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:26:57.559859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:57.559859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:26:57.559859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 612/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:26:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:26:57.564554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:57.673041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4228cc9-4700-4347-9c38-98ce95f20225 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:57.708628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:57.709290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:57.709600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:57.709923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:57.711379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:57.711683 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:57.713037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:57.726923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 613/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:26:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:57.732554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:57.834593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:57.842018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0d720d2-fb49-4a36-a1cd-b3b737897428 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:57.880139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:57.880977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:57.881299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:57.881655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:57.890444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:57.891991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:26:57.908747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:57.910084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:26:57.911266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 613/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:26:57 2022] GET /identity/v3/users/placement => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:26:57.916569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:57.966421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:58.030862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8914134d-cf90-471c-8ce4-749934f2e61a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:58.066372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:58.067037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:58.067319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:58.067586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:58.068415 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:58.068718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:58.070231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:58.087717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 614/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 12 08:26:57 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:58.093164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:58.197684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6ab068-60f0-4b97-a8ea-dd222589d96d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:58.238006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:58.238898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:58.239249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:58.239523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:58.251768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:58.253635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:26:58.276019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:58.277064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:58.278190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:26:58.278190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:26:58.278190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:26:58.278190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:26:58.278190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 614/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:26:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:26:58.283353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:58.400274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de75c222-8ece-437a-9cdd-6b14c71563cd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:58.402991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:58.440377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:58.441038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:58.441317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:58.441617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:58.442334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:58.442633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:58.444003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:58.455761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 615/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:26:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:26:58.461613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:58.470386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:58.563963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99499617-419b-4fa9-a32b-9c46f44bae88 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:58.600963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:58.602329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:58.602603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:58.602874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:58.609806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:58.611244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:26:58.625496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:26:58.626591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:26:58.627694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:26:58.627694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:26:58.627694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:26:58.627694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:26:58.627694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:26:58.627694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:26:58.627694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:26:58.627694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:26:58.631478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 615/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:26:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:26:58.632973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:58.743012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1f5c16-eb6b-4b4a-975d-538b469dc6f6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:58.780485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15192e63-086d-49e5-8eea-c7c95038c6bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:58.781139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192e63-086d-49e5-8eea-c7c95038c6bb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:58.781428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192e63-086d-49e5-8eea-c7c95038c6bb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:58.781711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15192e63-086d-49e5-8eea-c7c95038c6bb None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:58.782493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15192e63-086d-49e5-8eea-c7c95038c6bb None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:26:58.782801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15192e63-086d-49e5-8eea-c7c95038c6bb None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:58.784306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15192e63-086d-49e5-8eea-c7c95038c6bb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:58.799131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 616/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:26:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:26:58.805271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:26:58.877064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:26:58.922576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3187c1fa-d532-4410-ac78-c99dfbccf7d3 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:26:58.961307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d165dc81-aa5f-4a43-ad88-29057b410e76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:26:58.962698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dc81-aa5f-4a43-ad88-29057b410e76 None admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:26:58.962956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dc81-aa5f-4a43-ad88-29057b410e76 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:26:58.963233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d165dc81-aa5f-4a43-ad88-29057b410e76 None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/94eb335ec8004aa493080367f844d730/roles/48eb4b7efc744ce28a9b3dd160821614` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:26:58.978532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165dc81-aa5f-4a43-ad88-29057b410e76 None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=94eb335ec8004aa493080367f844d730, role_id=48eb4b7efc744ce28a9b3dd160821614)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:26:58.979970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d165dc81-aa5f-4a43-ad88-29057b410e76 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:26:58.996722 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 616/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:26:58 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/94eb335ec8004aa493080367f844d730/roles/48eb4b7efc744ce28a9b3dd160821614 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:27:01.052325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648a06-b690-4171-8711-d01c78201623 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:01.052971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648a06-b690-4171-8711-d01c78201623 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:01.052971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b648a06-b690-4171-8711-d01c78201623 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:01.054894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 617/1233] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:27:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:27:01.060210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2153-e0cb-4416-b543-5e6134261f94 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:01.060649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2153-e0cb-4416-b543-5e6134261f94 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:01.060760 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd0f2153-e0cb-4416-b543-5e6134261f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:01.078653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dd0f2153-e0cb-4416-b543-5e6134261f94 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:27:01.080167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dd0f2153-e0cb-4416-b543-5e6134261f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:27:01.169457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 617/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:27:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:27:01.197100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648a06-b690-4171-8711-d01c78201623 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:01.224422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:01.306837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b648a06-b690-4171-8711-d01c78201623 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:01.342291 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e87c6f-1215-4d6c-bb68-d278eb583f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:01.343085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87c6f-1215-4d6c-bb68-d278eb583f7b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:01.343361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87c6f-1215-4d6c-bb68-d278eb583f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:01.343635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e87c6f-1215-4d6c-bb68-d278eb583f7b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:01.354189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e87c6f-1215-4d6c-bb68-d278eb583f7b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-99e87c6f-1215-4d6c-bb68-d278eb583f7b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:27:01.361883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:01.363045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:01.363949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 618/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Tue Jul 12 08:27:01 2022] GET /identity/v3/roles/service => generated 85 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:01.370591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f2153-e0cb-4416-b543-5e6134261f94 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:01.420201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:01.477753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd0f2153-e0cb-4416-b543-5e6134261f94 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:01.513641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:01.514295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:01.514578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:01.514874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:01.515581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] RBAC: Adding query filter params (name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:01.515883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:01.517244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:01.530153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 618/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Tue Jul 12 08:27:01 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:01.531577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e87c6f-1215-4d6c-bb68-d278eb583f7b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:01.623256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:01.641120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e87c6f-1215-4d6c-bb68-d278eb583f7b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:01.675792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:01.676586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:01.676856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:01.677123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:01.689459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:01.690937 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:27:01.707948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:01.709157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:01.711161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:27:01.711161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:27:01.711161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:01.711161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:01.711161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 619/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:01.715131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:01.822805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-591c6955-489d-466e-9de3-e0fd192242bf None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:01.832097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:01.858404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:01.859054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:01.859329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:01.859599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:01.860316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:01.860617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:01.862001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:01.877532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 619/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:27:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:27:01.880238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:01.993409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-662ae261-1f67-4e01-9a33-aa0a186f1bd6 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:02.027849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:02.028646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:02.028936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:02.029213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:02.032267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:02.040376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:02.042082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:27:02.058248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:02.064414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:02.065372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 620/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:01 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:27:02.066004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:02.181521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd3869d-2141-424d-8c5a-74aed99efce0 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:02.221651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:02.222320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:02.222609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:02.222874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:02.223708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:02.224014 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:02.225456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:02.248881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 620/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 12 08:27:02 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:02.250059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:02.357569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0cc2ea7-e3b8-48f1-81bf-c16e50a58f1a None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:02.397119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b9833-c9b5-4cb5-9226-07558ade73e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:02.397886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9833-c9b5-4cb5-9226-07558ade73e9 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:02.398232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9833-c9b5-4cb5-9226-07558ade73e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:02.398521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927b9833-c9b5-4cb5-9226-07558ade73e9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:02.470070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:02.478036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9833-c9b5-4cb5-9226-07558ade73e9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:02.479515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927b9833-c9b5-4cb5-9226-07558ade73e9 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:02.599104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 621/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:27:02 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:27:02.600319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:02.632305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:02.718198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b62d4de8-a19b-4053-9b32-9c0b4ef6f4ad None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:02.759334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:02.760168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:02.760762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:02.761170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:02.773929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:02.775654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:27:02.796003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:02.797074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:02.798204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:27:02.798204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:27:02.798204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:02.798204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:02.798204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 621/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:02.802926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b9833-c9b5-4cb5-9226-07558ade73e9 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:02.905384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:02.911503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927b9833-c9b5-4cb5-9226-07558ade73e9 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:02.951980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:02.952640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:02.952925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:02.953205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:02.953955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:02.954265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:02.955653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:02.967522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 622/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:27:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:02.973267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:03.054469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:03.077582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a5c581-70e1-4727-be42-3966f8af07bd None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:03.115069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:03.115863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:03.116144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:03.116941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:03.124135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:03.125689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:27:03.140687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:03.141896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:03.147606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 622/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:27:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:03.148170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:03.259926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a9bebd7-2406-4796-92ca-df76c1cb9603 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:03.295433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a893a3f-fa97-4487-b1a7-bd8b18a18d75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:03.296091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893a3f-fa97-4487-b1a7-bd8b18a18d75 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:03.296370 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893a3f-fa97-4487-b1a7-bd8b18a18d75 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:03.296643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a893a3f-fa97-4487-b1a7-bd8b18a18d75 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:03.297447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a893a3f-fa97-4487-b1a7-bd8b18a18d75 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:03.297754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a893a3f-fa97-4487-b1a7-bd8b18a18d75 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:03.299214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a893a3f-fa97-4487-b1a7-bd8b18a18d75 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:03.312084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 623/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:27:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:27:03.318135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:03.435443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37cff0b-06c5-46a1-9443-df61fb3ef6eb None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:03.475426 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-487efd0c-6945-4303-a05f-2b35ad78272a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:03.476971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487efd0c-6945-4303-a05f-2b35ad78272a None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:03.477398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487efd0c-6945-4303-a05f-2b35ad78272a None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:03.477732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-487efd0c-6945-4303-a05f-2b35ad78272a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:03.478710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487efd0c-6945-4303-a05f-2b35ad78272a None admin] RBAC: Adding query filter params (role.id=48eb4b7efc744ce28a9b3dd160821614, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=94eb335ec8004aa493080367f844d730) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:03.479260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487efd0c-6945-4303-a05f-2b35ad78272a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:03.480742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-487efd0c-6945-4303-a05f-2b35ad78272a None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:03.489161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 623/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:27:03 2022] GET /identity/v3/role_assignments?user.id=94eb335ec8004aa493080367f844d730&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=48eb4b7efc744ce28a9b3dd160821614 => generated 608 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:05.781892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b2f8-e5a8-48ac-9b0e-26c0b81cad58 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:05.782436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b2f8-e5a8-48ac-9b0e-26c0b81cad58 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:05.782436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0731b2f8-e5a8-48ac-9b0e-26c0b81cad58 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:05.783897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 624/1247] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:27:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:27:05.790161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba6f40-8ec2-4cb5-b695-c0e1ab6e0c2c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:05.790659 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba6f40-8ec2-4cb5-b695-c0e1ab6e0c2c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:05.790752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fba6f40-8ec2-4cb5-b695-c0e1ab6e0c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:05.795824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:05.808382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3fba6f40-8ec2-4cb5-b695-c0e1ab6e0c2c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:27:05.809794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3fba6f40-8ec2-4cb5-b695-c0e1ab6e0c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:27:05.883084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 624/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:27:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:27:05.907187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731b2f8-e5a8-48ac-9b0e-26c0b81cad58 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:05.927465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:06.025075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0731b2f8-e5a8-48ac-9b0e-26c0b81cad58 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:06.063011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115817e-3972-4629-a4b2-3e61e93169af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:06.063863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115817e-3972-4629-a4b2-3e61e93169af None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:06.064246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115817e-3972-4629-a4b2-3e61e93169af None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:06.064541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7115817e-3972-4629-a4b2-3e61e93169af None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:06.076098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7115817e-3972-4629-a4b2-3e61e93169af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-7115817e-3972-4629-a4b2-3e61e93169af None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:27:06.083628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:06.084809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:06.085975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 625/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:27:05 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:06.091113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba6f40-8ec2-4cb5-b695-c0e1ab6e0c2c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:06.212121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fba6f40-8ec2-4cb5-b695-c0e1ab6e0c2c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:06.254786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:06.261955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:06.262885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:06.263238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:06.263706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:06.264729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:06.265129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:06.266745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:06.277346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 625/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:27:06 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:06.284742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115817e-3972-4629-a4b2-3e61e93169af None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:06.374359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:06.401237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7115817e-3972-4629-a4b2-3e61e93169af None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:06.442865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:06.443652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:06.443936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:06.444205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:06.456644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:06.458174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:27:06.476257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:06.477625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:06.478762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:27:06.478762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:27:06.478762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:06.478762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:06.478762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 626/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:06.483637 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:06.598147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeb4bd7-c79a-4b61-a5a2-770458a9aa94 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:06.634718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:06.635388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:06.635665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:06.635933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:06.636646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:06.636949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:06.638351 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:06.650844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 626/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:27:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:06.656728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:06.764649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5888e8f0-ba09-4a73-9dad-d6c090b68d92 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:06.797366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:06.807596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:06.808630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:06.808989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:06.809271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:06.820446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:06.822332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:27:06.838947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:06.840286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:27:06.841524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:06.845587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 627/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:06 2022] GET /identity/v3/users/placement => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:06.846762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:06.907531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:06.959126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e24867b-a14a-4cc4-bf95-8e210896dd15 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:06.997053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:06.997756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:06.998030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:06.998298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:06.999127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:06.999428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:07.000850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:07.020066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 627/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 12 08:27:06 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:07.027519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:07.153442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17be04fc-abc9-48ab-9c6c-b7a7eb84c6fb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:07.198062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3ce7-904c-415f-9b50-e393a6962067 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:07.198892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3ce7-904c-415f-9b50-e393a6962067 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:07.199238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3ce7-904c-415f-9b50-e393a6962067 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:07.199666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158e3ce7-904c-415f-9b50-e393a6962067 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:07.264775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:07.279008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3ce7-904c-415f-9b50-e393a6962067 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:07.280455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158e3ce7-904c-415f-9b50-e393a6962067 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:07.390289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 628/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:27:07 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:27:07.396287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:07.506521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8196b666-4247-44d2-98ca-49cd72d73ccc None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:07.522229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:07.547820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:07.548614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:07.548894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:07.549171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:07.559711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:07.561163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:27:07.578476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:07.579644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:07.580678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:27:07.580678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:27:07.580678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:07.580678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:07.580678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 628/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:27:07.586159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3ce7-904c-415f-9b50-e393a6962067 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:07.683928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:07.698009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158e3ce7-904c-415f-9b50-e393a6962067 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:07.735371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:07.736038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:07.736314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:07.736585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:07.737296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:07.737633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:07.739036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:07.751018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 629/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:27:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:07.757633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:07.862268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3feff27f-ff8d-441e-87a4-cc167bef431b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:07.899617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:07.900400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:07.900678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:07.901004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:07.907958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:07.909405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:27:07.923418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:07.924514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:07.930672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 629/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:27:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:07.931264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:08.041526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14949d2f-a2b4-477f-809d-64569b8ae1cb None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:08.076754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e89ff28-5791-496d-83e6-4e8cc95ab3a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:08.077641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ff28-5791-496d-83e6-4e8cc95ab3a0 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:08.077938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ff28-5791-496d-83e6-4e8cc95ab3a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:08.078214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e89ff28-5791-496d-83e6-4e8cc95ab3a0 None admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:08.079011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89ff28-5791-496d-83e6-4e8cc95ab3a0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:08.079400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89ff28-5791-496d-83e6-4e8cc95ab3a0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:08.081008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e89ff28-5791-496d-83e6-4e8cc95ab3a0 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:08.095383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 630/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:27:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:08.102263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:08.133766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:08.219409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82037fd3-d4c2-4b9c-9fb4-a048c6626c62 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:08.256899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52e0b7f9-7ed7-46ec-b34e-e93bd76b8fb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:08.257617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0b7f9-7ed7-46ec-b34e-e93bd76b8fb3 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:08.257900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0b7f9-7ed7-46ec-b34e-e93bd76b8fb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:08.258176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52e0b7f9-7ed7-46ec-b34e-e93bd76b8fb3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:08.259022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0b7f9-7ed7-46ec-b34e-e93bd76b8fb3 None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=94eb335ec8004aa493080367f844d730) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:08.259333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0b7f9-7ed7-46ec-b34e-e93bd76b8fb3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:08.260806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52e0b7f9-7ed7-46ec-b34e-e93bd76b8fb3 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:08.267245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 630/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:27:08 2022] GET /identity/v3/role_assignments?user.id=94eb335ec8004aa493080367f844d730&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 259 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:27:10.291775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc46a-ce3d-4786-9ec2-23fdb20f4adb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:10.292307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc46a-ce3d-4786-9ec2-23fdb20f4adb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:10.292307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-943bc46a-ce3d-4786-9ec2-23fdb20f4adb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:10.293703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 631/1261] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:27:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:27:10.298911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535147-8b01-452a-9432-c2a8c1c4813a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:10.299279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535147-8b01-452a-9432-c2a8c1c4813a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:10.299470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c535147-8b01-452a-9432-c2a8c1c4813a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:10.316780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9c535147-8b01-452a-9432-c2a8c1c4813a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:27:10.318001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9c535147-8b01-452a-9432-c2a8c1c4813a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:27:10.384886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 631/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:27:10 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:27:10.407540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bc46a-ce3d-4786-9ec2-23fdb20f4adb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:10.418198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:10.504664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-943bc46a-ce3d-4786-9ec2-23fdb20f4adb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:10.537951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff2e0e-7ed3-4f6a-8042-6520ffa27d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:10.538954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff2e0e-7ed3-4f6a-8042-6520ffa27d7d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:10.539236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff2e0e-7ed3-4f6a-8042-6520ffa27d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:10.539504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efff2e0e-7ed3-4f6a-8042-6520ffa27d7d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:10.549061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efff2e0e-7ed3-4f6a-8042-6520ffa27d7d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-efff2e0e-7ed3-4f6a-8042-6520ffa27d7d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:27:10.558081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:10.559198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:10.560060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 632/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:27:10 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:10.565325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535147-8b01-452a-9432-c2a8c1c4813a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:10.583541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:10.661045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c535147-8b01-452a-9432-c2a8c1c4813a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:10.694233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:10.695023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:10.695304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:10.695576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:10.696313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:10.696616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:10.698004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:10.705744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 632/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:27:10 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:10.711695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff2e0e-7ed3-4f6a-8042-6520ffa27d7d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:10.776374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:10.810177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efff2e0e-7ed3-4f6a-8042-6520ffa27d7d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:10.841752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:10.842522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:10.842807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:10.843083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:10.853794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:10.855232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:27:10.872266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:10.873323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:10.874609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:27:10.874609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:27:10.874609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:10.874609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:10.874609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 633/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:10.879241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:10.958029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:10.977235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ab5643-6b21-479f-9ed4-bd4abaf2b6d4 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:11.009949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:11.010600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:11.010881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:11.011153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:11.011862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:11.012164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:11.013533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:11.025643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 633/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:27:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:11.031282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:11.127563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae9ef7f0-7274-4b2c-a31f-19fa3b0d81ea None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:11.146215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:11.161389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:11.162201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:11.162478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:11.162745 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:11.171049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:11.172478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:27:11.186629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:11.187639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:11.188595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 634/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:11.193794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:11.292566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4added53-0a55-4b6d-b44f-d447400dec9d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:11.325141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:11.325831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:11.326109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:11.326381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:11.327210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:11.327518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:11.328971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:11.338049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:11.346540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 634/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 12 08:27:11 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:11.352748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:11.452785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6b3427-c585-442f-8897-465c3f353848 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:11.485126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:11.485933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:11.486212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:11.486482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:11.496850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:11.498298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:27:11.515226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:11.516262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:11.517359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:27:11.517359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:27:11.517359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:11.517359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:11.517359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 635/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:11.522291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:11.617614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed23aede-9410-4aef-9b26-01ee6452c5e2 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:11.652368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:11.653018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:11.653298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:11.653610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:11.654317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:11.654621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:11.655977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:11.667011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 635/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:27:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:11.672512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:11.703233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:11.772714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ec64d5e-600a-45aa-91b0-6fac2f0f741c None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:11.805339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:11.806140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:11.806420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:11.806688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:11.813054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:11.814516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:27:11.829462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:11.830499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:11.831766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 636/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:27:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:11.836521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:11.893306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:11.933821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca2f2b9-7b65-48f4-aad1-a85e4d17e460 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:11.965921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36d80ea-395f-4cb4-8fa5-4dd05c9704b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:11.966557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d80ea-395f-4cb4-8fa5-4dd05c9704b2 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:11.966835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d80ea-395f-4cb4-8fa5-4dd05c9704b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:11.967108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36d80ea-395f-4cb4-8fa5-4dd05c9704b2 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:11.967879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d80ea-395f-4cb4-8fa5-4dd05c9704b2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:11.968185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d80ea-395f-4cb4-8fa5-4dd05c9704b2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:11.969629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c36d80ea-395f-4cb4-8fa5-4dd05c9704b2 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:11.981206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 636/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:27:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:11.986979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:12.073939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:12.082479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc95b98-ed26-4a81-9198-27836cdce32e None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:12.114410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96b8e3f-0de3-4237-9fae-89a69b82e144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:12.115262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8e3f-0de3-4237-9fae-89a69b82e144 None admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:12.115535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8e3f-0de3-4237-9fae-89a69b82e144 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:12.115803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96b8e3f-0de3-4237-9fae-89a69b82e144 None admin] PATH_INFO: `/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/94eb335ec8004aa493080367f844d730/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:12.118277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b8e3f-0de3-4237-9fae-89a69b82e144 None admin] RBAC: Authorizing `identity:create_grant(project_id=d604d0b921624779aba7be0fb8f5efa5, user_id=94eb335ec8004aa493080367f844d730, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:12.119694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96b8e3f-0de3-4237-9fae-89a69b82e144 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:12.132321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 637/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Tue Jul 12 08:27:11 2022] PUT /identity/v3/projects/d604d0b921624779aba7be0fb8f5efa5/users/94eb335ec8004aa493080367f844d730/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:27:14.220482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb275-9bcf-41c1-b2b2-0e65f0c5531c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:14.221013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb275-9bcf-41c1-b2b2-0e65f0c5531c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:14.221013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bbb275-9bcf-41c1-b2b2-0e65f0c5531c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:14.222421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 637/1274] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:27:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:27:14.227666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f003a-8e10-4ab7-b161-42ade89447ae None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:14.228130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f003a-8e10-4ab7-b161-42ade89447ae None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:14.228225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-507f003a-8e10-4ab7-b161-42ade89447ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:14.245062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-507f003a-8e10-4ab7-b161-42ade89447ae None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:27:14.246280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-507f003a-8e10-4ab7-b161-42ade89447ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:27:14.310850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 638/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:27:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:27:14.334218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbb275-9bcf-41c1-b2b2-0e65f0c5531c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:14.438806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bbb275-9bcf-41c1-b2b2-0e65f0c5531c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:14.456076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:14.473409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dfda8-981b-49e5-a422-d43f0406deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:14.474164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dfda8-981b-49e5-a422-d43f0406deca None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:14.474445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dfda8-981b-49e5-a422-d43f0406deca None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:14.474718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e7dfda8-981b-49e5-a422-d43f0406deca None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:14.485545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e7dfda8-981b-49e5-a422-d43f0406deca None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-2e7dfda8-981b-49e5-a422-d43f0406deca None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 12 08:27:14.494076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:14.495231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:14.496440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 638/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Tue Jul 12 08:27:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:14.501238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f003a-8e10-4ab7-b161-42ade89447ae None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:14.579213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:14.597170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-507f003a-8e10-4ab7-b161-42ade89447ae None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:14.630314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:14.630965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:14.631254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:14.631554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:14.632345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:14.632646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:14.634033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:14.641845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 639/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Tue Jul 12 08:27:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:27:14.647566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dfda8-981b-49e5-a422-d43f0406deca None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:14.749920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e7dfda8-981b-49e5-a422-d43f0406deca None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:14.782066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:14.782832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:14.783108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:14.783375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:14.794015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:14.795440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:27:14.811965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:14.812833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:14.813796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:27:14.813796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:27:14.813796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:14.813796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:14.813796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 639/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:14.818887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:14.914834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3805e031-6d28-4348-a8cd-4337bf0201e2 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:14.946621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:14.947262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:14.947543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:14.947820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:14.948526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:14.948829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:14.950213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:14.962059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 640/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:27:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:14.967628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:14.999824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:15.066810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37294900-fc6b-4b1d-9fc2-bf174b90e736 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:15.098964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:15.099744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:15.100021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:15.100898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:15.108191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:15.109652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 12 08:27:15.123650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:15.124747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:15.126186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 640/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:15.130566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:15.135924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:15.244007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44a1dba6-19b8-494f-993a-0ede6be71ce4 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:15.277564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:15.278219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:15.278499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:15.278771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:15.279596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:15.279903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:15.281326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:15.298343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 641/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Tue Jul 12 08:27:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:15.304337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:15.392875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:15.403233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca5d4fe-c9f3-49b2-8e7a-d0843222970d None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:15.435655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de093-a21e-45de-bc69-c91e119d6a85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:15.436294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de093-a21e-45de-bc69-c91e119d6a85 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:15.436577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de093-a21e-45de-bc69-c91e119d6a85 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:15.436853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe2de093-a21e-45de-bc69-c91e119d6a85 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:15.505708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de093-a21e-45de-bc69-c91e119d6a85 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:15.507736 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe2de093-a21e-45de-bc69-c91e119d6a85 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:15.592473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:15.602774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 641/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Tue Jul 12 08:27:15 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 12 08:27:15.608623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:15.668871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:15.706874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fee10d-68b9-4a9e-83ea-a5498b24571b None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:15.739064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:15.739832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:15.740109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:15.740379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:15.750679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:15.752108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 12 08:27:15.769644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:15.770682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:15.771729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 12 08:27:15.771729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 12 08:27:15.771729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 12 08:27:15.771729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:15.771729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 642/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:27:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:15.777269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de093-a21e-45de-bc69-c91e119d6a85 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:15.871591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe2de093-a21e-45de-bc69-c91e119d6a85 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:15.904676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:15.905312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:15.905609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:15.905881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:15.906584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:15.906886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:15.908224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:15.919644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 642/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Tue Jul 12 08:27:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:15.925074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:16.020114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48a980a-c81f-434c-beb1-739c4dc54551 None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:16.033590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:16.054171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:16.054945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:16.055225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:16.055498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:16.061935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:16.063363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 12 08:27:16.076727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:16.077791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: ERROR keystone.server.flask.application Jul 12 08:27:16.078889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 643/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Tue Jul 12 08:27:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:16.083754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:16.132317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:16.181668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483ee709-8583-42cc-8bb7-ead420209a48 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:16.213279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2b122cf-1c9e-48c7-9723-950d0b5d8100 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:16.213944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b122cf-1c9e-48c7-9723-950d0b5d8100 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:16.214223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b122cf-1c9e-48c7-9723-950d0b5d8100 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:16.214498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2b122cf-1c9e-48c7-9723-950d0b5d8100 None admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:16.215268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b122cf-1c9e-48c7-9723-950d0b5d8100 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:16.215586 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b122cf-1c9e-48c7-9723-950d0b5d8100 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:16.217004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2b122cf-1c9e-48c7-9723-950d0b5d8100 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:16.229098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 643/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Tue Jul 12 08:27:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:16.235048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:16.331374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afd3438-d962-4456-96b2-c67114c96cbd None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:16.364527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793e6967-7523-4ec1-81a4-3db7b47eea1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:16.365162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e6967-7523-4ec1-81a4-3db7b47eea1e None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:16.365461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e6967-7523-4ec1-81a4-3db7b47eea1e None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:16.365739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793e6967-7523-4ec1-81a4-3db7b47eea1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:16.366600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e6967-7523-4ec1-81a4-3db7b47eea1e None admin] RBAC: Adding query filter params (role.id=7d196c74e73c4a518f6152de7edeed12, scope.project.id=d604d0b921624779aba7be0fb8f5efa5, user.id=94eb335ec8004aa493080367f844d730) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:16.366907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e6967-7523-4ec1-81a4-3db7b47eea1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:16.368318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-793e6967-7523-4ec1-81a4-3db7b47eea1e None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:16.374084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 644/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Tue Jul 12 08:27:16 2022] GET /identity/v3/role_assignments?user.id=94eb335ec8004aa493080367f844d730&scope.project.id=d604d0b921624779aba7be0fb8f5efa5&role.id=7d196c74e73c4a518f6152de7edeed12 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:18.417609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8d61-1fbf-4856-83a7-e96784f99201 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:18.418110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8d61-1fbf-4856-83a7-e96784f99201 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:18.418221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492b8d61-1fbf-4856-83a7-e96784f99201 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:18.419562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 644/1288] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:27:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:27:18.424833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371118e-57ad-4a09-a425-09b314cbd655 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:18.425253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371118e-57ad-4a09-a425-09b314cbd655 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:18.425387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8371118e-57ad-4a09-a425-09b314cbd655 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:18.442555 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8371118e-57ad-4a09-a425-09b314cbd655 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:27:18.443733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8371118e-57ad-4a09-a425-09b314cbd655 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:27:18.471835 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:18.509086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 645/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:27:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:27:18.531728 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b8d61-1fbf-4856-83a7-e96784f99201 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:18.628961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492b8d61-1fbf-4856-83a7-e96784f99201 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:18.639185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:18.662216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:18.663627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:18.663900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:18.664168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:18.664800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:18.666214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:18.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:18.679377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:18.680312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 645/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:27:18 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:18.685331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371118e-57ad-4a09-a425-09b314cbd655 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:18.780526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8371118e-57ad-4a09-a425-09b314cbd655 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:18.813274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9da1db-1e65-40f3-b7de-37616da96742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:18.813946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9da1db-1e65-40f3-b7de-37616da96742 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:18.814227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9da1db-1e65-40f3-b7de-37616da96742 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:18.814499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9da1db-1e65-40f3-b7de-37616da96742 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:18.815195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9da1db-1e65-40f3-b7de-37616da96742 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:18.815497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9da1db-1e65-40f3-b7de-37616da96742 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:18.816850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9da1db-1e65-40f3-b7de-37616da96742 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:18.821809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 646/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 12 08:27:18 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:18.827483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:18.928829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb4f67a7-e65f-49f3-868e-54661952a959 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:18.962196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62940d4-f417-4d0b-b09b-60c2e3965d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:18.962834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62940d4-f417-4d0b-b09b-60c2e3965d90 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:18.963110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62940d4-f417-4d0b-b09b-60c2e3965d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:18.963380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62940d4-f417-4d0b-b09b-60c2e3965d90 None admin] PATH_INFO: `/v3/services` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:18.964076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62940d4-f417-4d0b-b09b-60c2e3965d90 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:18.964381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62940d4-f417-4d0b-b09b-60c2e3965d90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:18.965758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62940d4-f417-4d0b-b09b-60c2e3965d90 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:18.970094 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 646/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 12 08:27:18 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:20.995869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1677-6a12-4abb-b70e-21a4d52a7a7e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:20.996433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1677-6a12-4abb-b70e-21a4d52a7a7e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:20.996433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c2c1677-6a12-4abb-b70e-21a4d52a7a7e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:20.997790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 647/1293] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:27:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:27:21.002791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9fee3-e1e1-4aff-8eaa-defc974bf2c9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:21.003229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9fee3-e1e1-4aff-8eaa-defc974bf2c9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:21.003330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb9fee3-e1e1-4aff-8eaa-defc974bf2c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:21.019480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-deb9fee3-e1e1-4aff-8eaa-defc974bf2c9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:27:21.020644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-deb9fee3-e1e1-4aff-8eaa-defc974bf2c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:27:21.050645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:21.086675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 647/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:27:21 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:27:21.109524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c1677-6a12-4abb-b70e-21a4d52a7a7e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:21.140217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:21.220862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c2c1677-6a12-4abb-b70e-21a4d52a7a7e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:21.252847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d786709e-92d7-47f3-8c36-285713249b34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:21.253451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786709e-92d7-47f3-8c36-285713249b34 None admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:21.253730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786709e-92d7-47f3-8c36-285713249b34 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:21.253999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d786709e-92d7-47f3-8c36-285713249b34 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:21.254707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786709e-92d7-47f3-8c36-285713249b34 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:21.256054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d786709e-92d7-47f3-8c36-285713249b34 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:21.268990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 648/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Tue Jul 12 08:27:21 2022] POST /identity/v3/services => generated 246 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:27:23.282782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fdda9-de72-4185-a4eb-174fbf35b43d None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:23.283348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fdda9-de72-4185-a4eb-174fbf35b43d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:23.283348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b3fdda9-de72-4185-a4eb-174fbf35b43d None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:23.284691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 648/1296] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:27:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:27:23.290071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be86302-a358-4193-848d-47f980beece0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:23.290465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be86302-a358-4193-848d-47f980beece0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:23.290697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8be86302-a358-4193-848d-47f980beece0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:23.307445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8be86302-a358-4193-848d-47f980beece0 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:27:23.308613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8be86302-a358-4193-848d-47f980beece0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:27:23.379178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 649/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:27:23 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:27:23.402513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fdda9-de72-4185-a4eb-174fbf35b43d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:23.500486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b3fdda9-de72-4185-a4eb-174fbf35b43d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:23.532714 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:23.533563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:23.533787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:23.534055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:23.534702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:23.536039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:23.548078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:23.549283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:23.550518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 649/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:27:23 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 12 08:27:23.555363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be86302-a358-4193-848d-47f980beece0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:23.573477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:23.652860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8be86302-a358-4193-848d-47f980beece0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:23.685096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:23.685767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:23.686046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:23.686319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:23.687015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:23.687320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:23.688683 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:23.694258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 650/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 12 08:27:23 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:23.700231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:23.730853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:23.796926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd7718b8-de42-4828-9f15-3e33f9a5e750 None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:23.829246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eff2482d-fcaf-492f-8534-b87daec34cae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:23.829931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2482d-fcaf-492f-8534-b87daec34cae None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:23.830214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2482d-fcaf-492f-8534-b87daec34cae None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:23.830489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eff2482d-fcaf-492f-8534-b87daec34cae None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:23.831278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2482d-fcaf-492f-8534-b87daec34cae None admin] RBAC: Adding query filter params (interface=public, service_id=afd4f2e51d1646c7a2e1d3469287ba06, region_id=RegionOne) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:23.831588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2482d-fcaf-492f-8534-b87daec34cae None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:23.832975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eff2482d-fcaf-492f-8534-b87daec34cae None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:23.838502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 650/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Tue Jul 12 08:27:23 2022] GET /identity/v3/endpoints?service_id=afd4f2e51d1646c7a2e1d3469287ba06&interface=public®ion_id=RegionOne => generated 194 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:23.844004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:23.923074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:23.940687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdc9f49-33bf-445c-ba79-0ab74fab614d None admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:23.973144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103aa88d-d703-4128-8776-73e07f959e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:23.973819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa88d-d703-4128-8776-73e07f959e82 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:23.974103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa88d-d703-4128-8776-73e07f959e82 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:23.974379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103aa88d-d703-4128-8776-73e07f959e82 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:23.975607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aa88d-d703-4128-8776-73e07f959e82 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:23.977113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103aa88d-d703-4128-8776-73e07f959e82 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:23.983723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 651/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Tue Jul 12 08:27:23 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:27:25.974272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ba1-bed7-471b-9864-6bbb82403d6f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:25.974864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ba1-bed7-471b-9864-6bbb82403d6f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:25.974864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-382d8ba1-bed7-471b-9864-6bbb82403d6f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:25.976224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 651/1302] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:27:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:27:25.981184 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb93c5-c6a4-42b2-b5d1-2af7623bed8b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:25.981596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb93c5-c6a4-42b2-b5d1-2af7623bed8b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:25.981758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6afb93c5-c6a4-42b2-b5d1-2af7623bed8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:25.998360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6afb93c5-c6a4-42b2-b5d1-2af7623bed8b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:27:25.999517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6afb93c5-c6a4-42b2-b5d1-2af7623bed8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:27:26.062604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 652/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:27:25 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 12 08:27:26.085542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8ba1-bed7-471b-9864-6bbb82403d6f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:26.185647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:26.193869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-382d8ba1-bed7-471b-9864-6bbb82403d6f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:26.232627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:26.233460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:26.233745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:26.234032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] PATH_INFO: `/v3/services/placement` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:26.234685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:26.236141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 12 08:27:26.247969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 12 08:27:26.249212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.get_or_create( Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application with Lock( Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self._enter() Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application return self.creator() Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application created_value = creator( Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: ERROR keystone.server.flask.application Jul 12 08:27:26.250147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 652/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Tue Jul 12 08:27:26 2022] GET /identity/v3/services/placement => generated 90 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 12 08:27:26.255258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb93c5-c6a4-42b2-b5d1-2af7623bed8b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:26.327467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:26.349661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6afb93c5-c6a4-42b2-b5d1-2af7623bed8b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:26.382579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50005554-4dcf-4d08-aab7-6c2d8506bff5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:26.383216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005554-4dcf-4d08-aab7-6c2d8506bff5 None admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:26.383492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005554-4dcf-4d08-aab7-6c2d8506bff5 None admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:26.383761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50005554-4dcf-4d08-aab7-6c2d8506bff5 None admin] PATH_INFO: `/v3/services` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:26.384445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50005554-4dcf-4d08-aab7-6c2d8506bff5 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:27:26.384744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50005554-4dcf-4d08-aab7-6c2d8506bff5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:26.386117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50005554-4dcf-4d08-aab7-6c2d8506bff5 None admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:26.391151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 653/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Tue Jul 12 08:27:26 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:27:26.400041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:27:26.500327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49a5523-67bf-4f56-8627-1256a99de58b None admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:27:26.534429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b556829-1f43-4ee9-a5df-c50f6d3980fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:27:26.535076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556829-1f43-4ee9-a5df-c50f6d3980fb None admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:27:26.535364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556829-1f43-4ee9-a5df-c50f6d3980fb None admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:27:26.535642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b556829-1f43-4ee9-a5df-c50f6d3980fb None admin] PATH_INFO: `/v3/endpoints` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:27:26.536386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b556829-1f43-4ee9-a5df-c50f6d3980fb None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:27:26.538261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b556829-1f43-4ee9-a5df-c50f6d3980fb None admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:27:26.555446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 653/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Tue Jul 12 08:27:26 2022] POST /identity/v3/endpoints => generated 331 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:27:36.388125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=30 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:27:36.551233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:29.418269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b14c-9d17-49c8-a129-996397717a7b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:29.418750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b14c-9d17-49c8-a129-996397717a7b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:29.418842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b2b14c-9d17-49c8-a129-996397717a7b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:29.424058 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 654/1307] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:29.425635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd3511-7ff4-462d-92f9-dd8a9d5873ed None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:29.426109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd3511-7ff4-462d-92f9-dd8a9d5873ed None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:29.426289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fd3511-7ff4-462d-92f9-dd8a9d5873ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:29.588039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-88fd3511-7ff4-462d-92f9-dd8a9d5873ed None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:29.589822 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-88fd3511-7ff4-462d-92f9-dd8a9d5873ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:29.731424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 654/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:29.784400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecec7f-6f0a-426c-afe9-56eb29ecbf7a None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:29.785055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecec7f-6f0a-426c-afe9-56eb29ecbf7a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:29.785640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eecec7f-6f0a-426c-afe9-56eb29ecbf7a None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:29.787263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 655/1309] 10.222.0.20 () {54 vars in 964 bytes} [Tue Jul 12 08:28:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:29.793788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6da2-f297-448d-a114-b0ff58d2336c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:29.794365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6da2-f297-448d-a114-b0ff58d2336c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:29.794886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04a6da2-f297-448d-a114-b0ff58d2336c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:29.875944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b04a6da2-f297-448d-a114-b0ff58d2336c None None] MFA Rules not processed for user `686a32aea0b945d9a76875110c8f84ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:29.877525 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b04a6da2-f297-448d-a114-b0ff58d2336c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:29.900778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:29.962034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 655/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Jul 12 08:28:29 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:29.971017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecec7f-6f0a-426c-afe9-56eb29ecbf7a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:29.973786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3eecec7f-6f0a-426c-afe9-56eb29ecbf7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:30.104050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eecec7f-6f0a-426c-afe9-56eb29ecbf7a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:30.187664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d44d5f-901a-41c5-9cf2-fda78bce2678 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:30.188576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d44d5f-901a-41c5-9cf2-fda78bce2678 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:30.189029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d44d5f-901a-41c5-9cf2-fda78bce2678 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:30.189483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d44d5f-901a-41c5-9cf2-fda78bce2678 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:30.191308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c4d44d5f-901a-41c5-9cf2-fda78bce2678 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:30.253137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:30.314923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d44d5f-901a-41c5-9cf2-fda78bce2678 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:30.317017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d44d5f-901a-41c5-9cf2-fda78bce2678 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:30.338800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 656/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:32.728382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da2a3-cba3-40fd-ab99-85bf48b22bdb None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:32.728886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da2a3-cba3-40fd-ab99-85bf48b22bdb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:32.728886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451da2a3-cba3-40fd-ab99-85bf48b22bdb None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:32.730716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 656/1312] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:32.735965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591324-8be0-4c2a-9508-305735859ef3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:32.736356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591324-8be0-4c2a-9508-305735859ef3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:32.736510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa591324-8be0-4c2a-9508-305735859ef3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:32.819166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-aa591324-8be0-4c2a-9508-305735859ef3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:32.820757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-aa591324-8be0-4c2a-9508-305735859ef3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:32.935097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 657/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:28:32.974461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da2a3-cba3-40fd-ab99-85bf48b22bdb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:32.976037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-451da2a3-cba3-40fd-ab99-85bf48b22bdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:33.081756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451da2a3-cba3-40fd-ab99-85bf48b22bdb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:33.156200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:33.159222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-770df08e-a9b0-4269-8806-4a2ce00caef1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:33.159911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df08e-a9b0-4269-8806-4a2ce00caef1 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:33.160840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df08e-a9b0-4269-8806-4a2ce00caef1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:33.161300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-770df08e-a9b0-4269-8806-4a2ce00caef1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:33.163405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-770df08e-a9b0-4269-8806-4a2ce00caef1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:33.284300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770df08e-a9b0-4269-8806-4a2ce00caef1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:33.285996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-770df08e-a9b0-4269-8806-4a2ce00caef1 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:33.303918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 657/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:35.615650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da4231-256a-4101-b2f4-7989a3ba12ed None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:35.616188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da4231-256a-4101-b2f4-7989a3ba12ed None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:35.616188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53da4231-256a-4101-b2f4-7989a3ba12ed None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:35.617586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 658/1315] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:35.622636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71be070-cc3f-468e-9f8f-107cae7fcc84 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:35.623074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71be070-cc3f-468e-9f8f-107cae7fcc84 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:35.623230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c71be070-cc3f-468e-9f8f-107cae7fcc84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:35.688968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c71be070-cc3f-468e-9f8f-107cae7fcc84 None None] MFA Rules not processed for user `6f25eff4460b401a9650f91f232be225`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:35.690216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c71be070-cc3f-468e-9f8f-107cae7fcc84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:35.743034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:35.787651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 658/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:35 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:28:35.827148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da4231-256a-4101-b2f4-7989a3ba12ed None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:35.828658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-53da4231-256a-4101-b2f4-7989a3ba12ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:35.838252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:35.930290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53da4231-256a-4101-b2f4-7989a3ba12ed None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:36.001374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3fab1e-e3a4-4eef-87f4-ccf205ecbc27 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:36.002029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fab1e-e3a4-4eef-87f4-ccf205ecbc27 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:36.002305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fab1e-e3a4-4eef-87f4-ccf205ecbc27 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:36.002572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3fab1e-e3a4-4eef-87f4-ccf205ecbc27 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:36.004971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7e3fab1e-e3a4-4eef-87f4-ccf205ecbc27 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:36.063499 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:36.109758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fab1e-e3a4-4eef-87f4-ccf205ecbc27 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:36.111212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3fab1e-e3a4-4eef-87f4-ccf205ecbc27 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:36.129384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 659/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:35 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:38.694495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184100e-beaf-42d4-856b-58c0ec680766 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:38.694998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184100e-beaf-42d4-856b-58c0ec680766 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:38.694998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b184100e-beaf-42d4-856b-58c0ec680766 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:38.696333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 659/1318] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:38.701399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1137-efc3-464d-9f1e-0cad7cd8f8de None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:38.701840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1137-efc3-464d-9f1e-0cad7cd8f8de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:38.701979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f3e1137-efc3-464d-9f1e-0cad7cd8f8de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:38.764309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6f3e1137-efc3-464d-9f1e-0cad7cd8f8de None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:38.765522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6f3e1137-efc3-464d-9f1e-0cad7cd8f8de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:38.861429 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 660/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:38 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:38.901175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184100e-beaf-42d4-856b-58c0ec680766 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:38.902741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b184100e-beaf-42d4-856b-58c0ec680766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:39.003483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b184100e-beaf-42d4-856b-58c0ec680766 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:39.075899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16adad1c-d962-43c9-8bf3-d1aaf902acfe service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:39.076533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adad1c-d962-43c9-8bf3-d1aaf902acfe service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:39.076813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adad1c-d962-43c9-8bf3-d1aaf902acfe service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:39.077085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16adad1c-d962-43c9-8bf3-d1aaf902acfe service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:39.078737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-16adad1c-d962-43c9-8bf3-d1aaf902acfe service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:39.085991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:39.188320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adad1c-d962-43c9-8bf3-d1aaf902acfe service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:39.189874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16adad1c-d962-43c9-8bf3-d1aaf902acfe service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:39.208949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 660/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:38 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:41.872580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233acc9-ca20-4ac8-a6c7-bd015fcb0856 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:41.873122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233acc9-ca20-4ac8-a6c7-bd015fcb0856 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:41.873122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c233acc9-ca20-4ac8-a6c7-bd015fcb0856 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:41.874667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 661/1321] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:41.879716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c6ac0-81eb-4404-a837-8170beb8ee67 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:41.880159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c6ac0-81eb-4404-a837-8170beb8ee67 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:41.880266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c6ac0-81eb-4404-a837-8170beb8ee67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:41.944261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a04c6ac0-81eb-4404-a837-8170beb8ee67 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:41.945599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a04c6ac0-81eb-4404-a837-8170beb8ee67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:42.002899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:42.046410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 661/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:42.083026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233acc9-ca20-4ac8-a6c7-bd015fcb0856 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:42.084565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c233acc9-ca20-4ac8-a6c7-bd015fcb0856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:42.104776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:42.196949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c233acc9-ca20-4ac8-a6c7-bd015fcb0856 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:42.270491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fccdeb-21a3-4113-8be8-35c89e0b511c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:42.271136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccdeb-21a3-4113-8be8-35c89e0b511c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:42.271413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccdeb-21a3-4113-8be8-35c89e0b511c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:42.271681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fccdeb-21a3-4113-8be8-35c89e0b511c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:42.273617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-49fccdeb-21a3-4113-8be8-35c89e0b511c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:42.342647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:42.381115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fccdeb-21a3-4113-8be8-35c89e0b511c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:42.382584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fccdeb-21a3-4113-8be8-35c89e0b511c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:42.400436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 662/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:44.517657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26859-1cb2-4eba-af9e-0a1deec6829d None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:44.518161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26859-1cb2-4eba-af9e-0a1deec6829d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:44.518161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9d26859-1cb2-4eba-af9e-0a1deec6829d None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:44.520163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 662/1324] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:44.525627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802624-103d-4a51-b95c-a6df1dd04d50 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:44.526051 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802624-103d-4a51-b95c-a6df1dd04d50 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:44.526165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74802624-103d-4a51-b95c-a6df1dd04d50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:44.589435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-74802624-103d-4a51-b95c-a6df1dd04d50 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:44.590640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-74802624-103d-4a51-b95c-a6df1dd04d50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:44.686700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 663/1325] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:44.725329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d26859-1cb2-4eba-af9e-0a1deec6829d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:44.726936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f9d26859-1cb2-4eba-af9e-0a1deec6829d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:44.833154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9d26859-1cb2-4eba-af9e-0a1deec6829d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:44.912259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad69b8c9-66e7-417c-bd2b-6485a1fdf960 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:44.912913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69b8c9-66e7-417c-bd2b-6485a1fdf960 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:44.913198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69b8c9-66e7-417c-bd2b-6485a1fdf960 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:44.913496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad69b8c9-66e7-417c-bd2b-6485a1fdf960 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:44.915214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ad69b8c9-66e7-417c-bd2b-6485a1fdf960 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:44.934289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:45.031331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69b8c9-66e7-417c-bd2b-6485a1fdf960 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:45.032775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad69b8c9-66e7-417c-bd2b-6485a1fdf960 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:45.052914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 663/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 328 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:47.156265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d3a78-1daf-4ea0-9b32-95db261d419e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:47.156789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d3a78-1daf-4ea0-9b32-95db261d419e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:47.156789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825d3a78-1daf-4ea0-9b32-95db261d419e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:47.158228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 664/1327] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:47.163687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332f66-12d8-416d-8997-4d7ab95763fb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:47.164112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332f66-12d8-416d-8997-4d7ab95763fb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:47.164242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e332f66-12d8-416d-8997-4d7ab95763fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:47.231142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3e332f66-12d8-416d-8997-4d7ab95763fb None None] MFA Rules not processed for user `6f25eff4460b401a9650f91f232be225`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:47.232274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3e332f66-12d8-416d-8997-4d7ab95763fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:47.299554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:47.337067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 664/1328] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:47 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:47.375461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d3a78-1daf-4ea0-9b32-95db261d419e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:47.377040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-825d3a78-1daf-4ea0-9b32-95db261d419e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:47.407182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:47.486154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825d3a78-1daf-4ea0-9b32-95db261d419e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:47.562550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f48ca1-9f4b-4180-913d-fe321bb65d0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:47.563196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f48ca1-9f4b-4180-913d-fe321bb65d0c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:47.563476 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f48ca1-9f4b-4180-913d-fe321bb65d0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:47.563748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f48ca1-9f4b-4180-913d-fe321bb65d0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:47.565374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d2f48ca1-9f4b-4180-913d-fe321bb65d0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:47.641710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:47.676959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f48ca1-9f4b-4180-913d-fe321bb65d0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:47.678424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f48ca1-9f4b-4180-913d-fe321bb65d0c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:47.715184 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 665/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:47 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 340 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:49.982417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d59c8-a7bc-48a0-81bc-a90e59c86832 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:49.982959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d59c8-a7bc-48a0-81bc-a90e59c86832 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:49.982959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-961d59c8-a7bc-48a0-81bc-a90e59c86832 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:49.984388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 665/1330] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:49.990221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f63499-8686-4031-b805-fb3e4b46bbc4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:49.990646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f63499-8686-4031-b805-fb3e4b46bbc4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:49.990761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f63499-8686-4031-b805-fb3e4b46bbc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:50.054858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f5f63499-8686-4031-b805-fb3e4b46bbc4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:50.056057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5f63499-8686-4031-b805-fb3e4b46bbc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:50.148895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 666/1331] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:50.200062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc8b5-3dd4-43c6-a224-96024c9df477 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:50.200342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc8b5-3dd4-43c6-a224-96024c9df477 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:50.200615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a13cc8b5-3dd4-43c6-a224-96024c9df477 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:50.202026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 666/1332] 10.222.0.20 () {54 vars in 964 bytes} [Tue Jul 12 08:28:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:50.207799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf4a97-9e05-46e6-b25e-bca458a93895 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:50.208112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf4a97-9e05-46e6-b25e-bca458a93895 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:50.208387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05bf4a97-9e05-46e6-b25e-bca458a93895 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:50.256055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:50.286966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-05bf4a97-9e05-46e6-b25e-bca458a93895 None None] MFA Rules not processed for user `686a32aea0b945d9a76875110c8f84ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:50.288188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-05bf4a97-9e05-46e6-b25e-bca458a93895 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:50.366807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 667/1333] 10.222.0.20 () {58 vars in 1061 bytes} [Tue Jul 12 08:28:50 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:50.378213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc8b5-3dd4-43c6-a224-96024c9df477 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:50.379844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a13cc8b5-3dd4-43c6-a224-96024c9df477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:50.481691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a13cc8b5-3dd4-43c6-a224-96024c9df477 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:50.553357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9da4633f-04ad-40e0-a81f-12e74fe9eba5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:50.554027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4633f-04ad-40e0-a81f-12e74fe9eba5 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:50.554308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4633f-04ad-40e0-a81f-12e74fe9eba5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:50.554579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9da4633f-04ad-40e0-a81f-12e74fe9eba5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:50.556226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9da4633f-04ad-40e0-a81f-12e74fe9eba5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:50.584058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:50.666124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4633f-04ad-40e0-a81f-12e74fe9eba5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:50.667575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9da4633f-04ad-40e0-a81f-12e74fe9eba5 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:50.685842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 667/1334] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:52.978786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508646e2-3e10-44dd-be3a-d524c8aec509 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:52.979362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508646e2-3e10-44dd-be3a-d524c8aec509 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:52.979362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-508646e2-3e10-44dd-be3a-d524c8aec509 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:52.980696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 668/1335] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:52.986000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2acdf-a9ed-4adc-8136-27639bf85273 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:52.986394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2acdf-a9ed-4adc-8136-27639bf85273 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:52.986552 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d2acdf-a9ed-4adc-8136-27639bf85273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:53.051106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b6d2acdf-a9ed-4adc-8136-27639bf85273 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:53.052352 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b6d2acdf-a9ed-4adc-8136-27639bf85273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:53.128984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:53.151486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 668/1336] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:53.191493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508646e2-3e10-44dd-be3a-d524c8aec509 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:53.193016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-508646e2-3e10-44dd-be3a-d524c8aec509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:53.299454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-508646e2-3e10-44dd-be3a-d524c8aec509 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:53.328757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:53.372972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739cc861-b30c-4f28-8c57-6845e1bd22b3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:53.373638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc861-b30c-4f28-8c57-6845e1bd22b3 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:53.373920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc861-b30c-4f28-8c57-6845e1bd22b3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:53.374192 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739cc861-b30c-4f28-8c57-6845e1bd22b3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:53.375801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-739cc861-b30c-4f28-8c57-6845e1bd22b3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:53.481531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cc861-b30c-4f28-8c57-6845e1bd22b3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:53.482959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-739cc861-b30c-4f28-8c57-6845e1bd22b3 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:53.500865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 669/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:28:56.140515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e36f9-a03e-4859-8f67-63f810b2451b None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:56.141074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e36f9-a03e-4859-8f67-63f810b2451b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:56.141074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29e36f9-a03e-4859-8f67-63f810b2451b None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:56.142484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 669/1338] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:28:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:28:56.148590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e110-faf0-465d-b86a-f2a2613c9b12 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:56.149004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e110-faf0-465d-b86a-f2a2613c9b12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:56.149152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1734e110-faf0-465d-b86a-f2a2613c9b12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:56.214281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1734e110-faf0-465d-b86a-f2a2613c9b12 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:28:56.215480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1734e110-faf0-465d-b86a-f2a2613c9b12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:56.224603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:56.310284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 670/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:28:56 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:28:56.346208 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e36f9-a03e-4859-8f67-63f810b2451b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:28:56.348367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b29e36f9-a03e-4859-8f67-63f810b2451b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:56.453481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29e36f9-a03e-4859-8f67-63f810b2451b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:28:56.525286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c47e7ecd-b418-4f62-be70-3646a9b27fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:28:56.525950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e7ecd-b418-4f62-be70-3646a9b27fac service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:28:56.526229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e7ecd-b418-4f62-be70-3646a9b27fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:28:56.526498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c47e7ecd-b418-4f62-be70-3646a9b27fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:28:56.528133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c47e7ecd-b418-4f62-be70-3646a9b27fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:28:56.562396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:28:56.634300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e7ecd-b418-4f62-be70-3646a9b27fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:28:56.635718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c47e7ecd-b418-4f62-be70-3646a9b27fac service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:28:56.655499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 670/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:28:56 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:00.770556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced63c0-e3d5-45d6-8092-8f826989bfc6 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:00.771074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced63c0-e3d5-45d6-8092-8f826989bfc6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:00.771074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bced63c0-e3d5-45d6-8092-8f826989bfc6 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:00.772397 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 671/1341] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:00.778211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4c0a-bca0-444f-beb2-27ad3dee9073 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:00.778652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4c0a-bca0-444f-beb2-27ad3dee9073 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:00.778894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2aa4c0a-bca0-444f-beb2-27ad3dee9073 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:00.844216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c2aa4c0a-bca0-444f-beb2-27ad3dee9073 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:00.845411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c2aa4c0a-bca0-444f-beb2-27ad3dee9073 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:00.930817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:00.943557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 671/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:00.982290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced63c0-e3d5-45d6-8092-8f826989bfc6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:00.983814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bced63c0-e3d5-45d6-8092-8f826989bfc6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:01.088153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bced63c0-e3d5-45d6-8092-8f826989bfc6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:01.124077 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:01.161944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df579a2e-91f9-490d-9d27-33f5a43b25c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:01.162590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579a2e-91f9-490d-9d27-33f5a43b25c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:01.162868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579a2e-91f9-490d-9d27-33f5a43b25c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:01.163140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df579a2e-91f9-490d-9d27-33f5a43b25c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:01.164799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df579a2e-91f9-490d-9d27-33f5a43b25c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:01.274072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df579a2e-91f9-490d-9d27-33f5a43b25c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:01.275519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df579a2e-91f9-490d-9d27-33f5a43b25c7 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:01.293602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 672/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:29:03.945701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb5b9-3f1a-4e47-8487-0b423f074999 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:03.946285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb5b9-3f1a-4e47-8487-0b423f074999 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:03.946285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4eb5b9-3f1a-4e47-8487-0b423f074999 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:03.947668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 672/1344] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:03.953638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76374d7-aaee-48e1-9882-884afdf73e02 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:03.954145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76374d7-aaee-48e1-9882-884afdf73e02 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:03.954239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76374d7-aaee-48e1-9882-884afdf73e02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:04.023472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b76374d7-aaee-48e1-9882-884afdf73e02 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:04.024721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b76374d7-aaee-48e1-9882-884afdf73e02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:04.043368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:04.121461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 673/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:03 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:04.160179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eb5b9-3f1a-4e47-8487-0b423f074999 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:04.161875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bd4eb5b9-3f1a-4e47-8487-0b423f074999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:04.267601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4eb5b9-3f1a-4e47-8487-0b423f074999 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:04.339676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8af4a8-48a0-4733-adfb-7dec7fba87ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:04.340317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af4a8-48a0-4733-adfb-7dec7fba87ea service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:04.340598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af4a8-48a0-4733-adfb-7dec7fba87ea service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:04.340868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8af4a8-48a0-4733-adfb-7dec7fba87ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:04.342562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3a8af4a8-48a0-4733-adfb-7dec7fba87ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:04.384965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:04.453080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8af4a8-48a0-4733-adfb-7dec7fba87ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:04.454571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8af4a8-48a0-4733-adfb-7dec7fba87ea service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:04.474163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 673/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:04 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:08.769614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca881bd-38b5-4b92-b57f-80797b24015b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:08.770115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca881bd-38b5-4b92-b57f-80797b24015b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:08.770223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca881bd-38b5-4b92-b57f-80797b24015b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:08.771535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 674/1347] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:08.777517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd4a34-5aa8-41a8-8c58-92e6ff310a1e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:08.778005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd4a34-5aa8-41a8-8c58-92e6ff310a1e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:08.778102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cbd4a34-5aa8-41a8-8c58-92e6ff310a1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:08.847821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2cbd4a34-5aa8-41a8-8c58-92e6ff310a1e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:08.849048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2cbd4a34-5aa8-41a8-8c58-92e6ff310a1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:08.947199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:08.950232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 674/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:08.988327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca881bd-38b5-4b92-b57f-80797b24015b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:08.989899 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ca881bd-38b5-4b92-b57f-80797b24015b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:09.100381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca881bd-38b5-4b92-b57f-80797b24015b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:09.151535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:09.181258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092c18e2-3151-41bd-a833-09f7c7b3f5da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:09.181929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c18e2-3151-41bd-a833-09f7c7b3f5da service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:09.182239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c18e2-3151-41bd-a833-09f7c7b3f5da service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:09.182509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092c18e2-3151-41bd-a833-09f7c7b3f5da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:09.184141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-092c18e2-3151-41bd-a833-09f7c7b3f5da service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:09.308348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c18e2-3151-41bd-a833-09f7c7b3f5da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:09.309836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092c18e2-3151-41bd-a833-09f7c7b3f5da service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:09.328364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 675/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:14.321609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e4f0a-5cf2-418d-b58e-e72a9d64dbf8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:14.322084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e4f0a-5cf2-418d-b58e-e72a9d64dbf8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:14.322179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1e4f0a-5cf2-418d-b58e-e72a9d64dbf8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:14.323882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 675/1350] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:29:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:14.329296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22407d-23f4-4d7d-a407-4172012e1c73 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:14.329723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22407d-23f4-4d7d-a407-4172012e1c73 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:14.329945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb22407d-23f4-4d7d-a407-4172012e1c73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:14.493731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-eb22407d-23f4-4d7d-a407-4172012e1c73 None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:14.495393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-eb22407d-23f4-4d7d-a407-4172012e1c73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:14.540190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:14.667512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 676/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:29:14 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:18.851290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f934f-49b6-4146-ba39-9154229d261a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:18.851817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f934f-49b6-4146-ba39-9154229d261a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:18.851817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-902f934f-49b6-4146-ba39-9154229d261a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:18.853437 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 676/1352] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:29:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:18.858397 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506f36-b1a0-4502-a805-6e293a5a93fc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:18.859206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506f36-b1a0-4502-a805-6e293a5a93fc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:18.859704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac506f36-b1a0-4502-a805-6e293a5a93fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:18.938158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ac506f36-b1a0-4502-a805-6e293a5a93fc None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:18.940373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac506f36-b1a0-4502-a805-6e293a5a93fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:19.017119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:19.055240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 677/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:29:18 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:20.480206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3f8b-d0fa-444f-a5c2-299657bf0de9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:20.480724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3f8b-d0fa-444f-a5c2-299657bf0de9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:20.480724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c8a3f8b-d0fa-444f-a5c2-299657bf0de9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:20.482145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 677/1354] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:29:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:20.487893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea0461-f8db-4125-a334-0a8e7a3027cd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:20.488313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea0461-f8db-4125-a334-0a8e7a3027cd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:20.488567 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dea0461-f8db-4125-a334-0a8e7a3027cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:20.565171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8dea0461-f8db-4125-a334-0a8e7a3027cd None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:20.566398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8dea0461-f8db-4125-a334-0a8e7a3027cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:20.672610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 678/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:29:20 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:24.047980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addd8b6-2b19-43fb-a933-0e1e102c50b0 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:24.048510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addd8b6-2b19-43fb-a933-0e1e102c50b0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:24.048510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9addd8b6-2b19-43fb-a933-0e1e102c50b0 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:24.050694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 678/1356] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:24.056709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3337-8b75-4028-9e98-b1ee7c6ebf46 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:24.057189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3337-8b75-4028-9e98-b1ee7c6ebf46 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:24.057282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32b3337-8b75-4028-9e98-b1ee7c6ebf46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:24.106176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:24.141785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c32b3337-8b75-4028-9e98-b1ee7c6ebf46 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:24.143063 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c32b3337-8b75-4028-9e98-b1ee7c6ebf46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:24.246230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 679/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:24.300010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d69c-5eae-4980-a85b-e02e903a77b9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:24.301085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d69c-5eae-4980-a85b-e02e903a77b9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:24.302458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd7d69c-5eae-4980-a85b-e02e903a77b9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:24.304946 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 679/1358] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 12 08:29:24 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:24.314155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2eaf0-7b38-4cbe-aee9-3293c6bcd71d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:24.314845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2eaf0-7b38-4cbe-aee9-3293c6bcd71d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:24.315608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f2eaf0-7b38-4cbe-aee9-3293c6bcd71d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:24.399516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-72f2eaf0-7b38-4cbe-aee9-3293c6bcd71d None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:24.400697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-72f2eaf0-7b38-4cbe-aee9-3293c6bcd71d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:24.459234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:24.529992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 680/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 12 08:29:24 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:29:24.537759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7d69c-5eae-4980-a85b-e02e903a77b9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:24.539255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dcd7d69c-5eae-4980-a85b-e02e903a77b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:24.702651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd7d69c-5eae-4980-a85b-e02e903a77b9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:24.783809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:24.826421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3baa3d98-8a24-4de5-891e-6923da6e7db2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:24.827443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3d98-8a24-4de5-891e-6923da6e7db2 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:24.827964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3d98-8a24-4de5-891e-6923da6e7db2 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:24.828444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3baa3d98-8a24-4de5-891e-6923da6e7db2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:24.831146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3baa3d98-8a24-4de5-891e-6923da6e7db2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:24.934733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa3d98-8a24-4de5-891e-6923da6e7db2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:24.936324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3baa3d98-8a24-4de5-891e-6923da6e7db2 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:24.956251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 680/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:27.201546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65b7c-56ee-441b-809f-1a8be2a719e4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:27.202132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65b7c-56ee-441b-809f-1a8be2a719e4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:27.202132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2db65b7c-56ee-441b-809f-1a8be2a719e4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:27.203787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 681/1361] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:27.209469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56077-e414-4d6b-b420-e8f3d2bce3c5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:27.210314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56077-e414-4d6b-b420-e8f3d2bce3c5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:27.210592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24e56077-e414-4d6b-b420-e8f3d2bce3c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:27.279663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-24e56077-e414-4d6b-b420-e8f3d2bce3c5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:27.280870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-24e56077-e414-4d6b-b420-e8f3d2bce3c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:27.320802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:27.389464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 681/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:27.438374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65b7c-56ee-441b-809f-1a8be2a719e4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:27.441389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2db65b7c-56ee-441b-809f-1a8be2a719e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:27.602069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2db65b7c-56ee-441b-809f-1a8be2a719e4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:27.612103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:27.742676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06157faa-2349-4cf2-97b1-d301804dcf6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:27.743405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157faa-2349-4cf2-97b1-d301804dcf6b service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:27.743757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157faa-2349-4cf2-97b1-d301804dcf6b service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:27.744103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06157faa-2349-4cf2-97b1-d301804dcf6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:27.745872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-06157faa-2349-4cf2-97b1-d301804dcf6b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:27.841360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06157faa-2349-4cf2-97b1-d301804dcf6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:27.843093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06157faa-2349-4cf2-97b1-d301804dcf6b service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:27.862916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 682/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 425 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:30.337997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba84b-5535-4ab4-9f79-93a5895d7b27 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:30.338548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba84b-5535-4ab4-9f79-93a5895d7b27 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:30.338548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9ba84b-5535-4ab4-9f79-93a5895d7b27 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:30.340120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 682/1364] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:30.345771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abdf79-91e1-4c0a-ba3f-3dbbd3632053 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:30.346762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abdf79-91e1-4c0a-ba3f-3dbbd3632053 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:30.347050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12abdf79-91e1-4c0a-ba3f-3dbbd3632053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:30.362133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:30.425384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-12abdf79-91e1-4c0a-ba3f-3dbbd3632053 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:30.426736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-12abdf79-91e1-4c0a-ba3f-3dbbd3632053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:30.531210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 683/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:30.580360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278efc-5787-45bc-a5e8-529a8870c476 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:30.582217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278efc-5787-45bc-a5e8-529a8870c476 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:30.582821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c278efc-5787-45bc-a5e8-529a8870c476 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:30.584255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 683/1366] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 12 08:29:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:30.590961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab17e26-d946-47eb-b5d6-56be741080a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:30.591194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab17e26-d946-47eb-b5d6-56be741080a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:30.591476 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bab17e26-d946-47eb-b5d6-56be741080a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:30.674825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bab17e26-d946-47eb-b5d6-56be741080a0 None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:30.676064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bab17e26-d946-47eb-b5d6-56be741080a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:30.715393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:30.810810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 684/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 12 08:29:30 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 221 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:30.820106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278efc-5787-45bc-a5e8-529a8870c476 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:30.821700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8c278efc-5787-45bc-a5e8-529a8870c476 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:30.980349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c278efc-5787-45bc-a5e8-529a8870c476 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:31.002587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:31.101708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1b36b2f-09e0-4d8a-adcd-b8c9dd5f2978 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:31.102420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36b2f-09e0-4d8a-adcd-b8c9dd5f2978 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:31.102696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36b2f-09e0-4d8a-adcd-b8c9dd5f2978 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:31.102962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1b36b2f-09e0-4d8a-adcd-b8c9dd5f2978 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:31.104591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e1b36b2f-09e0-4d8a-adcd-b8c9dd5f2978 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:31.199344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b36b2f-09e0-4d8a-adcd-b8c9dd5f2978 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:31.200936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1b36b2f-09e0-4d8a-adcd-b8c9dd5f2978 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:31.224113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 684/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:32.186143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b211-7e4a-4917-ae09-9ce0a3886570 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:32.186705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b211-7e4a-4917-ae09-9ce0a3886570 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:32.186705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b4b211-7e4a-4917-ae09-9ce0a3886570 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:32.188236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 685/1369] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:32.193515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c3744-9dda-49fc-a353-e016de97e9c9 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:32.193940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c3744-9dda-49fc-a353-e016de97e9c9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:32.194157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b9c3744-9dda-49fc-a353-e016de97e9c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:32.226446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:32.263765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5b9c3744-9dda-49fc-a353-e016de97e9c9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:32.264984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b9c3744-9dda-49fc-a353-e016de97e9c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:32.368073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 685/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:32.714677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b19fc7-b8cb-4e84-abc9-45fd9de85100 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:32.714677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b19fc7-b8cb-4e84-abc9-45fd9de85100 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:32.715125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b19fc7-b8cb-4e84-abc9-45fd9de85100 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:32.716672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 686/1371] 10.222.0.20 () {54 vars in 963 bytes} [Tue Jul 12 08:29:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:32.721682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add62bba-ce61-4d47-ae60-3a54b2e256ec None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:32.722088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add62bba-ce61-4d47-ae60-3a54b2e256ec None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:32.722466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add62bba-ce61-4d47-ae60-3a54b2e256ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:32.803542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-add62bba-ce61-4d47-ae60-3a54b2e256ec None None] MFA Rules not processed for user `91d8f3d11ef745d988fa2749f2a885ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:32.804747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-add62bba-ce61-4d47-ae60-3a54b2e256ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:32.854873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:32.888747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 686/1372] 10.222.0.20 () {58 vars in 1060 bytes} [Tue Jul 12 08:29:32 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:32.896458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b19fc7-b8cb-4e84-abc9-45fd9de85100 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:32.898547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a8b19fc7-b8cb-4e84-abc9-45fd9de85100 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:33.011171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b19fc7-b8cb-4e84-abc9-45fd9de85100 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:33.054216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:33.092881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33023c23-c040-41da-9afa-085d92884618 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:33.093734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023c23-c040-41da-9afa-085d92884618 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:33.094141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023c23-c040-41da-9afa-085d92884618 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:33.094495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33023c23-c040-41da-9afa-085d92884618 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:33.096774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-33023c23-c040-41da-9afa-085d92884618 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:33.215022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33023c23-c040-41da-9afa-085d92884618 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:33.216721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33023c23-c040-41da-9afa-085d92884618 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:33.237115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 687/1373] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:33.416820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298443b-e267-425d-a6e8-f28acafd46c5 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:33.416820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298443b-e267-425d-a6e8-f28acafd46c5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:33.416820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3298443b-e267-425d-a6e8-f28acafd46c5 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:33.418557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 687/1374] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:33.426292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ca0f9-86d2-40ca-8263-56405022717e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:33.426476 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ca0f9-86d2-40ca-8263-56405022717e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:33.426753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ca0f9-86d2-40ca-8263-56405022717e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:33.494633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-772ca0f9-86d2-40ca-8263-56405022717e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:33.495908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-772ca0f9-86d2-40ca-8263-56405022717e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:33.518791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:33.607216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 688/1375] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:33.654424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298443b-e267-425d-a6e8-f28acafd46c5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:33.655961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3298443b-e267-425d-a6e8-f28acafd46c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:33.803147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3298443b-e267-425d-a6e8-f28acafd46c5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:33.853327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:33.916218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7572b62-6f57-4092-bb99-ba995bc07d88 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:33.916863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572b62-6f57-4092-bb99-ba995bc07d88 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:33.917141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572b62-6f57-4092-bb99-ba995bc07d88 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:33.917430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7572b62-6f57-4092-bb99-ba995bc07d88 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:33.919087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b7572b62-6f57-4092-bb99-ba995bc07d88 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:34.010901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7572b62-6f57-4092-bb99-ba995bc07d88 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:34.012493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7572b62-6f57-4092-bb99-ba995bc07d88 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:34.031032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 688/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:36.139556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee90a5-ee8a-4abf-9712-d9ab360796ba None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:36.140048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee90a5-ee8a-4abf-9712-d9ab360796ba None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:36.140141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee90a5-ee8a-4abf-9712-d9ab360796ba None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:36.141676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 689/1377] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:36.146951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3829-2dff-434d-80dd-3ae58f187b67 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:36.147687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3829-2dff-434d-80dd-3ae58f187b67 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:36.147797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b3829-2dff-434d-80dd-3ae58f187b67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:36.223059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4a3b3829-2dff-434d-80dd-3ae58f187b67 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:36.224263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4a3b3829-2dff-434d-80dd-3ae58f187b67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:36.230893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:36.342681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 689/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:36.387161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee90a5-ee8a-4abf-9712-d9ab360796ba None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:36.388665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-63ee90a5-ee8a-4abf-9712-d9ab360796ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:36.535496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee90a5-ee8a-4abf-9712-d9ab360796ba None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:36.539012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:36.668284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9de8c7d-7bca-46d1-9f86-04994f679303 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:36.668936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de8c7d-7bca-46d1-9f86-04994f679303 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:36.669221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de8c7d-7bca-46d1-9f86-04994f679303 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:36.672318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9de8c7d-7bca-46d1-9f86-04994f679303 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:36.672318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9de8c7d-7bca-46d1-9f86-04994f679303 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:36.787283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de8c7d-7bca-46d1-9f86-04994f679303 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:36.788936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9de8c7d-7bca-46d1-9f86-04994f679303 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:36.815259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 690/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:38.922649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4617c0-22f1-4c99-89bb-ce59c039a082 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:38.923814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4617c0-22f1-4c99-89bb-ce59c039a082 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:38.923814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4617c0-22f1-4c99-89bb-ce59c039a082 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:38.925197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 690/1380] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:38.930447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1080-520b-4acc-8af9-162c6d5842cf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:38.930910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1080-520b-4acc-8af9-162c6d5842cf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:38.931002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-becf1080-520b-4acc-8af9-162c6d5842cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:38.942104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:39.002128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-becf1080-520b-4acc-8af9-162c6d5842cf None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:39.003461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-becf1080-520b-4acc-8af9-162c6d5842cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:39.112958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 691/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:39.156635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4617c0-22f1-4c99-89bb-ce59c039a082 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:39.159054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2f4617c0-22f1-4c99-89bb-ce59c039a082 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:39.316264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:39.327901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4617c0-22f1-4c99-89bb-ce59c039a082 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:39.459791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac486cc-70ea-44d5-9d92-8f33b12fd911 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:39.460486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac486cc-70ea-44d5-9d92-8f33b12fd911 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:39.460771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac486cc-70ea-44d5-9d92-8f33b12fd911 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:39.461043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac486cc-70ea-44d5-9d92-8f33b12fd911 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:39.462756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6ac486cc-70ea-44d5-9d92-8f33b12fd911 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:39.561977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac486cc-70ea-44d5-9d92-8f33b12fd911 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:39.563749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac486cc-70ea-44d5-9d92-8f33b12fd911 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:39.574992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:39.585684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 691/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:41.687205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324dde7-0656-49ec-b9f1-bc224ae841c8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:41.687739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324dde7-0656-49ec-b9f1-bc224ae841c8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:41.687962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8324dde7-0656-49ec-b9f1-bc224ae841c8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:41.690071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 692/1383] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:41.696348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef806-1750-45b2-bd61-16fc87433d40 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:41.696801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef806-1750-45b2-bd61-16fc87433d40 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:41.696902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00ef806-1750-45b2-bd61-16fc87433d40 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:41.764364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c00ef806-1750-45b2-bd61-16fc87433d40 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:41.765674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c00ef806-1750-45b2-bd61-16fc87433d40 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:41.866434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 692/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:41.910814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324dde7-0656-49ec-b9f1-bc224ae841c8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:41.912848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8324dde7-0656-49ec-b9f1-bc224ae841c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:42.002916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:42.068718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8324dde7-0656-49ec-b9f1-bc224ae841c8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:42.188210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e88ea3f-1b42-42b5-9881-990c39bc944f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:42.189864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ea3f-1b42-42b5-9881-990c39bc944f service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:42.190156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ea3f-1b42-42b5-9881-990c39bc944f service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:42.190457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e88ea3f-1b42-42b5-9881-990c39bc944f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:42.192231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6e88ea3f-1b42-42b5-9881-990c39bc944f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:42.249787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:42.292057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88ea3f-1b42-42b5-9881-990c39bc944f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:42.293693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e88ea3f-1b42-42b5-9881-990c39bc944f service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:42.312016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 693/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 402 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:44.442004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f5e1-ba77-4147-ab46-798357a670fe None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:44.442709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f5e1-ba77-4147-ab46-798357a670fe None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:44.442709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b2f5e1-ba77-4147-ab46-798357a670fe None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:44.443937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 693/1386] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:44.449061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f096-e9f0-499d-aa50-de4b97c49a1f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:44.449673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f096-e9f0-499d-aa50-de4b97c49a1f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:44.449673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a9f096-e9f0-499d-aa50-de4b97c49a1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:44.516433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-86a9f096-e9f0-499d-aa50-de4b97c49a1f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:44.518492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-86a9f096-e9f0-499d-aa50-de4b97c49a1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:44.626344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 694/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:44.676616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f5e1-ba77-4147-ab46-798357a670fe None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:44.678118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-89b2f5e1-ba77-4147-ab46-798357a670fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:44.770975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:44.849565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b2f5e1-ba77-4147-ab46-798357a670fe None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:44.988488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1248f98b-14ab-4a11-9df6-150ccebbef4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:44.989051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248f98b-14ab-4a11-9df6-150ccebbef4b service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:44.989371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248f98b-14ab-4a11-9df6-150ccebbef4b service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:44.989708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1248f98b-14ab-4a11-9df6-150ccebbef4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:44.991265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1248f98b-14ab-4a11-9df6-150ccebbef4b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:45.029668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:45.093712 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248f98b-14ab-4a11-9df6-150ccebbef4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:45.096783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1248f98b-14ab-4a11-9df6-150ccebbef4b service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:45.119469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 694/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 443 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:47.206096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05cd7-a532-49e1-9756-1ad0b89b4065 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:47.206768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05cd7-a532-49e1-9756-1ad0b89b4065 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:47.206768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca05cd7-a532-49e1-9756-1ad0b89b4065 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:47.208228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 695/1389] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:29:47.213152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebbace-a043-4e76-960f-7f9c7264f22a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:47.213595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebbace-a043-4e76-960f-7f9c7264f22a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:47.213747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ebbace-a043-4e76-960f-7f9c7264f22a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:47.278010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-46ebbace-a043-4e76-960f-7f9c7264f22a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:47.279196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-46ebbace-a043-4e76-960f-7f9c7264f22a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:47.376824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 695/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:29:47.426781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05cd7-a532-49e1-9756-1ad0b89b4065 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:47.428284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2ca05cd7-a532-49e1-9756-1ad0b89b4065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:47.458614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:47.575315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca05cd7-a532-49e1-9756-1ad0b89b4065 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:47.680284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:47.692913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20305b5-d9ef-436f-952d-22cfc8519828 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:47.693588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20305b5-d9ef-436f-952d-22cfc8519828 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:47.693874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20305b5-d9ef-436f-952d-22cfc8519828 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:47.694150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20305b5-d9ef-436f-952d-22cfc8519828 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:47.695785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a20305b5-d9ef-436f-952d-22cfc8519828 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:47.788060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20305b5-d9ef-436f-952d-22cfc8519828 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:47.789707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20305b5-d9ef-436f-952d-22cfc8519828 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:47.808539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 696/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:48.450269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ec6c-52af-4f3e-b7d5-eb438aeabba9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:48.450791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ec6c-52af-4f3e-b7d5-eb438aeabba9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:48.450791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446ec6c-52af-4f3e-b7d5-eb438aeabba9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:48.452181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 696/1392] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:48.457916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076150c5-5623-4fe5-ac48-ff9e11755c49 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:48.458332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076150c5-5623-4fe5-ac48-ff9e11755c49 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:48.458474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076150c5-5623-4fe5-ac48-ff9e11755c49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:48.523181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-076150c5-5623-4fe5-ac48-ff9e11755c49 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:48.524382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-076150c5-5623-4fe5-ac48-ff9e11755c49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:48.583946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:48.622760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 697/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:48.678387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904750ae-eae6-4d18-b89e-ad71c3b43039 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:48.678749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904750ae-eae6-4d18-b89e-ad71c3b43039 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:48.679140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-904750ae-eae6-4d18-b89e-ad71c3b43039 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:48.680611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 697/1394] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jul 12 08:29:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:29:48.685701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b1692-44a7-48be-8612-96d3cec12bf5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:48.685991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b1692-44a7-48be-8612-96d3cec12bf5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:48.686263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b7b1692-44a7-48be-8612-96d3cec12bf5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:48.760912 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2b7b1692-44a7-48be-8612-96d3cec12bf5 None None] MFA Rules not processed for user `993e107cc04e4ce6b9abd9997c29381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:48.762142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2b7b1692-44a7-48be-8612-96d3cec12bf5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:48.836710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 698/1395] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jul 12 08:29:48 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:48.844923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904750ae-eae6-4d18-b89e-ad71c3b43039 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:48.846611 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-904750ae-eae6-4d18-b89e-ad71c3b43039 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:48.860797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:48.951633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-904750ae-eae6-4d18-b89e-ad71c3b43039 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:49.030480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2755bf-1dfc-4173-b52a-85127ee239be service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993e107cc04e4ce6b9abd9997c29381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:49.031122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2755bf-1dfc-4173-b52a-85127ee239be service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:49.031403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2755bf-1dfc-4173-b52a-85127ee239be service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:49.031670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2755bf-1dfc-4173-b52a-85127ee239be service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:49.033640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f2755bf-1dfc-4173-b52a-85127ee239be service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:49.102456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:49.143774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2755bf-1dfc-4173-b52a-85127ee239be service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:49.145236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f2755bf-1dfc-4173-b52a-85127ee239be service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:49.164157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 698/1396] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:49.883436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d191-135f-4299-a2a9-bac1348c5cfc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:49.883925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d191-135f-4299-a2a9-bac1348c5cfc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:49.883925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b2d191-135f-4299-a2a9-bac1348c5cfc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:49.931521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533365cc-3a7d-4fd2-b473-4ba846aff654 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:49.932102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533365cc-3a7d-4fd2-b473-4ba846aff654 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:49.932102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-533365cc-3a7d-4fd2-b473-4ba846aff654 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:49.933471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 699/1397] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:49.938332 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0336c7-768a-4aad-b4ef-d5cbabd36aa2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:49.938613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0336c7-768a-4aad-b4ef-d5cbabd36aa2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:49.938889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0336c7-768a-4aad-b4ef-d5cbabd36aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:49.951754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d3b2d191-135f-4299-a2a9-bac1348c5cfc None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:49.952996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3b2d191-135f-4299-a2a9-bac1348c5cfc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:49.961384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:50.004131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cb0336c7-768a-4aad-b4ef-d5cbabd36aa2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:50.005339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cb0336c7-768a-4aad-b4ef-d5cbabd36aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:50.042362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 699/1398] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:29:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:50.090268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dbfc3-475c-440d-a931-086984be18f8 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:50.090616 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dbfc3-475c-440d-a931-086984be18f8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:50.090895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4dbfc3-475c-440d-a931-086984be18f8 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:50.092304 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 700/1399] 10.222.0.20 () {54 vars in 942 bytes} [Tue Jul 12 08:29:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:29:50.098485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a12df-c307-4e66-b28f-5b03dc6a576e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:50.098769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a12df-c307-4e66-b28f-5b03dc6a576e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:50.099048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3a12df-c307-4e66-b28f-5b03dc6a576e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:50.113763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 700/1400] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:29:50.159178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0336c7-768a-4aad-b4ef-d5cbabd36aa2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:50.160508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cb0336c7-768a-4aad-b4ef-d5cbabd36aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:50.182252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-de3a12df-c307-4e66-b28f-5b03dc6a576e None None] MFA Rules not processed for user `5de7841acf434c53a3c17ee73fae76e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:50.183565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-de3a12df-c307-4e66-b28f-5b03dc6a576e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:50.196575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:50.273071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:50.287057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0336c7-768a-4aad-b4ef-d5cbabd36aa2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:50.296243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 701/1401] 10.222.0.20 () {58 vars in 1039 bytes} [Tue Jul 12 08:29:50 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:29:50.306003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a12df-c307-4e66-b28f-5b03dc6a576e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:50.315328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3a12df-c307-4e66-b28f-5b03dc6a576e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:50.399945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c21ffa6d-f734-4ee4-835e-745a4bc0b96d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:50.400505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffa6d-f734-4ee4-835e-745a4bc0b96d service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:50.400783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffa6d-f734-4ee4-835e-745a4bc0b96d service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:50.401044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c21ffa6d-f734-4ee4-835e-745a4bc0b96d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:50.402731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c21ffa6d-f734-4ee4-835e-745a4bc0b96d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:50.420250 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58df6b91-72a0-4cd8-9ef5-5c39b6bd6306 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:50.421012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df6b91-72a0-4cd8-9ef5-5c39b6bd6306 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:50.421391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df6b91-72a0-4cd8-9ef5-5c39b6bd6306 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:50.421792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58df6b91-72a0-4cd8-9ef5-5c39b6bd6306 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:50.421955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:50.424358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-58df6b91-72a0-4cd8-9ef5-5c39b6bd6306 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:50.494686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ffa6d-f734-4ee4-835e-745a4bc0b96d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:50.496293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c21ffa6d-f734-4ee4-835e-745a4bc0b96d service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:50.506324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df6b91-72a0-4cd8-9ef5-5c39b6bd6306 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:50.507903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58df6b91-72a0-4cd8-9ef5-5c39b6bd6306 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:50.516076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 702/1402] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:29:50 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 08:29:50.517600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 701/1403] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:52.662632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5f70-c60d-4d6a-a971-99fc248566c5 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:52.663163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5f70-c60d-4d6a-a971-99fc248566c5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:52.663163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bf5f70-c60d-4d6a-a971-99fc248566c5 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:52.664699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 703/1404] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:52.669951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868310-436c-4cb6-8d15-85359db0fa1e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:52.670355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868310-436c-4cb6-8d15-85359db0fa1e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:52.670448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56868310-436c-4cb6-8d15-85359db0fa1e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:52.748273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-56868310-436c-4cb6-8d15-85359db0fa1e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:52.750267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-56868310-436c-4cb6-8d15-85359db0fa1e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:52.852544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:52.865895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 702/1405] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:52.904243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5f70-c60d-4d6a-a971-99fc248566c5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:52.905856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-58bf5f70-c60d-4d6a-a971-99fc248566c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:52.916869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:53.077305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bf5f70-c60d-4d6a-a971-99fc248566c5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:53.161569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:53.204249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dc3a762-e965-4484-8184-f96893112032 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:53.204905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3a762-e965-4484-8184-f96893112032 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:53.205186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3a762-e965-4484-8184-f96893112032 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:53.205486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc3a762-e965-4484-8184-f96893112032 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:53.207127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2dc3a762-e965-4484-8184-f96893112032 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:53.308688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3a762-e965-4484-8184-f96893112032 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:53.310324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dc3a762-e965-4484-8184-f96893112032 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:53.337623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 704/1406] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 434 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:29:55.428353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625388-2d21-42ba-a178-d52b31598b47 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:55.428856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625388-2d21-42ba-a178-d52b31598b47 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:55.428958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59625388-2d21-42ba-a178-d52b31598b47 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:55.430333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 703/1407] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:29:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:29:55.435621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a7f9-8147-433a-a3db-baefd790f568 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:55.436014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a7f9-8147-433a-a3db-baefd790f568 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:55.436242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff38a7f9-8147-433a-a3db-baefd790f568 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:55.504500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ff38a7f9-8147-433a-a3db-baefd790f568 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:29:55.505756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ff38a7f9-8147-433a-a3db-baefd790f568 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:55.556194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:55.614890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 705/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:29:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:29:55.669135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625388-2d21-42ba-a178-d52b31598b47 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:29:55.669135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-59625388-2d21-42ba-a178-d52b31598b47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:55.877983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59625388-2d21-42ba-a178-d52b31598b47 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:29:55.951951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:29:56.005169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95d7b87b-7873-4948-9fc9-6141bdd1d959 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:29:56.005864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b87b-7873-4948-9fc9-6141bdd1d959 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:29:56.006150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b87b-7873-4948-9fc9-6141bdd1d959 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:29:56.006521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95d7b87b-7873-4948-9fc9-6141bdd1d959 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:29:56.008318 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-95d7b87b-7873-4948-9fc9-6141bdd1d959 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:29:56.129874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7b87b-7873-4948-9fc9-6141bdd1d959 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:29:56.131420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95d7b87b-7873-4948-9fc9-6141bdd1d959 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:29:56.152447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 704/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:29:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 486 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:05.612709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=23 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:06.150012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=64 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:13.022727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79b4d-23b3-44e9-b573-d21262191c56 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:13.023343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79b4d-23b3-44e9-b573-d21262191c56 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:13.023343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a79b4d-23b3-44e9-b573-d21262191c56 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:13.024659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 706/1410] 10.222.0.20 () {54 vars in 918 bytes} [Tue Jul 12 08:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:13.029761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fcbf-c6ac-4e6c-ba15-5dad84fab555 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:13.030195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fcbf-c6ac-4e6c-ba15-5dad84fab555 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:13.030439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f2fcbf-c6ac-4e6c-ba15-5dad84fab555 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:13.103811 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b5f2fcbf-c6ac-4e6c-ba15-5dad84fab555 None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:13.105005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b5f2fcbf-c6ac-4e6c-ba15-5dad84fab555 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:13.211233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 705/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jul 12 08:30:13 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:13.226142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824b77-25df-4d9d-b6c4-dd49f6822b88 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:13.226425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824b77-25df-4d9d-b6c4-dd49f6822b88 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:13.226699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36824b77-25df-4d9d-b6c4-dd49f6822b88 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:13.228058 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 707/1412] 10.222.0.20 () {54 vars in 918 bytes} [Tue Jul 12 08:30:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:13.232649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676aee-839c-40f7-b572-6c8736383c04 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:13.232936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676aee-839c-40f7-b572-6c8736383c04 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:13.233212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e676aee-839c-40f7-b572-6c8736383c04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:13.303782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:13.306818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1e676aee-839c-40f7-b572-6c8736383c04 None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:13.308481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1e676aee-839c-40f7-b572-6c8736383c04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:13.421918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 706/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Tue Jul 12 08:30:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:15.949344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13675e-524e-4ac5-88eb-76b53703880c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:15.949942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13675e-524e-4ac5-88eb-76b53703880c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:15.949942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b13675e-524e-4ac5-88eb-76b53703880c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:15.951357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 708/1414] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:30:15.957022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4f6f-500c-4758-bed6-b9b10ecb48b2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:15.957570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4f6f-500c-4758-bed6-b9b10ecb48b2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:15.957668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816b4f6f-500c-4758-bed6-b9b10ecb48b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:16.036174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-816b4f6f-500c-4758-bed6-b9b10ecb48b2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:16.037462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-816b4f6f-500c-4758-bed6-b9b10ecb48b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:16.112065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:16.172660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 707/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:30:16.228179 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13675e-524e-4ac5-88eb-76b53703880c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:16.229713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2b13675e-524e-4ac5-88eb-76b53703880c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:16.400761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b13675e-524e-4ac5-88eb-76b53703880c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:16.489923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:16.537804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68c0a1ba-99d5-4755-a3fc-6fdca73a654e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:16.538452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a1ba-99d5-4755-a3fc-6fdca73a654e service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:16.538735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a1ba-99d5-4755-a3fc-6fdca73a654e service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:16.538999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68c0a1ba-99d5-4755-a3fc-6fdca73a654e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:16.541133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-68c0a1ba-99d5-4755-a3fc-6fdca73a654e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:16.644769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0a1ba-99d5-4755-a3fc-6fdca73a654e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:16.646377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68c0a1ba-99d5-4755-a3fc-6fdca73a654e service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:16.664711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 709/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:17.567467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c164d87-c5eb-4fac-9a1c-a9c3a7dba97c None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:17.567989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c164d87-c5eb-4fac-9a1c-a9c3a7dba97c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:17.567989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c164d87-c5eb-4fac-9a1c-a9c3a7dba97c None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:17.569333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 708/1417] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:30:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:17.574364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081a371-4775-41ae-b742-25a4233e96fc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:17.574756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081a371-4775-41ae-b742-25a4233e96fc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:17.574918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e081a371-4775-41ae-b742-25a4233e96fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:17.652026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e081a371-4775-41ae-b742-25a4233e96fc None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:17.653223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e081a371-4775-41ae-b742-25a4233e96fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:17.679542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:17.750331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 710/1418] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:17.900779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c164d87-c5eb-4fac-9a1c-a9c3a7dba97c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:17.902240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0c164d87-c5eb-4fac-9a1c-a9c3a7dba97c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:18.052139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c164d87-c5eb-4fac-9a1c-a9c3a7dba97c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:18.092639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:18.168075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d45c86-b2ba-4cbd-a65f-eb2a13f89d08 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:18.168650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d45c86-b2ba-4cbd-a65f-eb2a13f89d08 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:18.168932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d45c86-b2ba-4cbd-a65f-eb2a13f89d08 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:18.169215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d45c86-b2ba-4cbd-a65f-eb2a13f89d08 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:18.170894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-45d45c86-b2ba-4cbd-a65f-eb2a13f89d08 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:18.259843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d45c86-b2ba-4cbd-a65f-eb2a13f89d08 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:18.261495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d45c86-b2ba-4cbd-a65f-eb2a13f89d08 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:18.282166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 709/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:19.177927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556091-2a22-4d96-8939-4a241adbbbfa None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:19.178519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556091-2a22-4d96-8939-4a241adbbbfa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:19.178519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32556091-2a22-4d96-8939-4a241adbbbfa None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:19.179834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 711/1420] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:30:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:19.184731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7815e-0946-45f6-b076-44269a2c7413 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:19.185165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7815e-0946-45f6-b076-44269a2c7413 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:19.185309 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dd7815e-0946-45f6-b076-44269a2c7413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:19.238832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:19.263958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7dd7815e-0946-45f6-b076-44269a2c7413 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:19.265196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7dd7815e-0946-45f6-b076-44269a2c7413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:19.361460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 710/1421] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:19.512138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32556091-2a22-4d96-8939-4a241adbbbfa None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:19.513620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-32556091-2a22-4d96-8939-4a241adbbbfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:19.658177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32556091-2a22-4d96-8939-4a241adbbbfa None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:19.670041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:19.775028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768e454e-c068-4656-b274-36e90b9e6673 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:19.775679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e454e-c068-4656-b274-36e90b9e6673 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:19.775959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e454e-c068-4656-b274-36e90b9e6673 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:19.776231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768e454e-c068-4656-b274-36e90b9e6673 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:19.777890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-768e454e-c068-4656-b274-36e90b9e6673 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:19.866713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e454e-c068-4656-b274-36e90b9e6673 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:19.868311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768e454e-c068-4656-b274-36e90b9e6673 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:19.887244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 712/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:20.750673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8cf7d-cb68-4fbc-902e-99b305cf734a None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:20.751203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8cf7d-cb68-4fbc-902e-99b305cf734a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:20.751203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece8cf7d-cb68-4fbc-902e-99b305cf734a None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:20.752555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 711/1423] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:30:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:20.757611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4ec5-763f-4ce3-940c-47c9ff6c9a97 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:20.758018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4ec5-763f-4ce3-940c-47c9ff6c9a97 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:20.758163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f4ec5-763f-4ce3-940c-47c9ff6c9a97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:20.776450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:20.831842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-781f4ec5-763f-4ce3-940c-47c9ff6c9a97 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:20.833030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-781f4ec5-763f-4ce3-940c-47c9ff6c9a97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:20.926582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 713/1424] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:30:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:30:21.078798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8cf7d-cb68-4fbc-902e-99b305cf734a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:21.080317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ece8cf7d-cb68-4fbc-902e-99b305cf734a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:21.190970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:21.228091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece8cf7d-cb68-4fbc-902e-99b305cf734a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:21.456585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fafc0df-6af1-4a8b-b170-2487bdb339b6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:21.457224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc0df-6af1-4a8b-b170-2487bdb339b6 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:21.457534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc0df-6af1-4a8b-b170-2487bdb339b6 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:21.457803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fafc0df-6af1-4a8b-b170-2487bdb339b6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:21.459418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5fafc0df-6af1-4a8b-b170-2487bdb339b6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:21.533979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:21.548142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafc0df-6af1-4a8b-b170-2487bdb339b6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:21.549754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fafc0df-6af1-4a8b-b170-2487bdb339b6 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:21.567326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 712/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 489 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:30:22.424970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7d0c3-45e2-4a2c-822b-8db85aef5a55 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:22.425553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7d0c3-45e2-4a2c-822b-8db85aef5a55 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:22.425553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c7d0c3-45e2-4a2c-822b-8db85aef5a55 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:22.426908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 714/1426] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:30:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:22.431740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b86e8-92ef-4707-8e9f-19d2f1b921e1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:22.432186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b86e8-92ef-4707-8e9f-19d2f1b921e1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:22.432298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402b86e8-92ef-4707-8e9f-19d2f1b921e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:22.504743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-402b86e8-92ef-4707-8e9f-19d2f1b921e1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:22.505962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-402b86e8-92ef-4707-8e9f-19d2f1b921e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:22.601176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 713/1427] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:30:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:22.751346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7d0c3-45e2-4a2c-822b-8db85aef5a55 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:22.752775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-53c7d0c3-45e2-4a2c-822b-8db85aef5a55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:22.837273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:22.897977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c7d0c3-45e2-4a2c-822b-8db85aef5a55 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:23.008369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80dfeab5-2f4b-4246-82b5-4b135b7d3483 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:23.008932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfeab5-2f4b-4246-82b5-4b135b7d3483 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:23.009208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfeab5-2f4b-4246-82b5-4b135b7d3483 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:23.009509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80dfeab5-2f4b-4246-82b5-4b135b7d3483 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:23.011135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-80dfeab5-2f4b-4246-82b5-4b135b7d3483 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:23.058525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:23.099119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfeab5-2f4b-4246-82b5-4b135b7d3483 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:23.100697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80dfeab5-2f4b-4246-82b5-4b135b7d3483 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:23.118684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 715/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:23.922898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e77f-5b09-45a9-8d05-4023b007131e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:23.923459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e77f-5b09-45a9-8d05-4023b007131e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:23.923459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e89e77f-5b09-45a9-8d05-4023b007131e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:23.924841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 714/1429] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:30:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:23.929729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1bf01-8ae1-4e6b-a4cf-6e95f86bdca1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:23.930196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1bf01-8ae1-4e6b-a4cf-6e95f86bdca1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:23.930310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea1bf01-8ae1-4e6b-a4cf-6e95f86bdca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:24.007592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cea1bf01-8ae1-4e6b-a4cf-6e95f86bdca1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:24.008788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cea1bf01-8ae1-4e6b-a4cf-6e95f86bdca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:24.103608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 716/1430] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:30:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:24.254954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89e77f-5b09-45a9-8d05-4023b007131e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:24.256501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3e89e77f-5b09-45a9-8d05-4023b007131e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:24.305090 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:24.400963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e89e77f-5b09-45a9-8d05-4023b007131e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:24.513619 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac094ab-33dc-4db4-b4fe-6d16a4c7c205 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:24.514196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac094ab-33dc-4db4-b4fe-6d16a4c7c205 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:24.514473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac094ab-33dc-4db4-b4fe-6d16a4c7c205 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:24.514745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac094ab-33dc-4db4-b4fe-6d16a4c7c205 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:24.516419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bac094ab-33dc-4db4-b4fe-6d16a4c7c205 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:24.523677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:24.606941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac094ab-33dc-4db4-b4fe-6d16a4c7c205 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:24.608535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac094ab-33dc-4db4-b4fe-6d16a4c7c205 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:24.627337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 715/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:25.451929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d612f-c3f4-4389-9ba1-cdb3a28fedbc None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:25.452451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d612f-c3f4-4389-9ba1-cdb3a28fedbc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:25.452558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7d612f-c3f4-4389-9ba1-cdb3a28fedbc None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:25.454712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 717/1432] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:30:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:25.459627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5514-0cab-4b0a-9bc8-4f0d0540e49d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:25.460056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5514-0cab-4b0a-9bc8-4f0d0540e49d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:25.460169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82cb5514-0cab-4b0a-9bc8-4f0d0540e49d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:25.533927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-82cb5514-0cab-4b0a-9bc8-4f0d0540e49d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:25.535112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-82cb5514-0cab-4b0a-9bc8-4f0d0540e49d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:25.600719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:25.630014 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 716/1433] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:30:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:25.781892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d612f-c3f4-4389-9ba1-cdb3a28fedbc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:25.783459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8f7d612f-c3f4-4389-9ba1-cdb3a28fedbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:25.801048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:25.928047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7d612f-c3f4-4389-9ba1-cdb3a28fedbc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:26.014240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:26.041139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90bbca34-904f-4eb0-85f0-29acc5281a1f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:26.041873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbca34-904f-4eb0-85f0-29acc5281a1f service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:26.042081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbca34-904f-4eb0-85f0-29acc5281a1f service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:26.042415 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90bbca34-904f-4eb0-85f0-29acc5281a1f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:26.044117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-90bbca34-904f-4eb0-85f0-29acc5281a1f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:26.134096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbca34-904f-4eb0-85f0-29acc5281a1f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:26.135687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90bbca34-904f-4eb0-85f0-29acc5281a1f service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:26.153289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 718/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:26.961903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa295f-3f6a-4719-a910-515b98d03f2f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:26.962486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa295f-3f6a-4719-a910-515b98d03f2f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:26.962486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fa295f-3f6a-4719-a910-515b98d03f2f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:26.963853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 717/1435] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:30:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:26.968810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e255-bdad-470b-9420-641686c7f145 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:26.969254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e255-bdad-470b-9420-641686c7f145 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:26.969354 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f8e255-bdad-470b-9420-641686c7f145 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:27.044460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-06f8e255-bdad-470b-9420-641686c7f145 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:27.045682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-06f8e255-bdad-470b-9420-641686c7f145 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:27.088148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:27.142245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 719/1436] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:30:27.297405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa295f-3f6a-4719-a910-515b98d03f2f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:27.299534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e3fa295f-3f6a-4719-a910-515b98d03f2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:27.447521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fa295f-3f6a-4719-a910-515b98d03f2f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:27.500364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:27.559062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54623819-8a53-4d04-84dc-eb55664ccaf7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:27.559629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623819-8a53-4d04-84dc-eb55664ccaf7 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:27.559906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623819-8a53-4d04-84dc-eb55664ccaf7 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:27.560177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54623819-8a53-4d04-84dc-eb55664ccaf7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:27.561840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-54623819-8a53-4d04-84dc-eb55664ccaf7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:27.649065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54623819-8a53-4d04-84dc-eb55664ccaf7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:27.650690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54623819-8a53-4d04-84dc-eb55664ccaf7 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:27.668887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 718/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:28.481659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c7f7-ed51-446f-869d-325be1c0b04b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:28.482191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c7f7-ed51-446f-869d-325be1c0b04b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:28.482191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c370c7f7-ed51-446f-869d-325be1c0b04b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:28.483597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 720/1438] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:30:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:28.489157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46256ee0-82e1-49f1-9420-8a85cf0913ce None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:28.489620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46256ee0-82e1-49f1-9420-8a85cf0913ce None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:28.489754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46256ee0-82e1-49f1-9420-8a85cf0913ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:28.563135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-46256ee0-82e1-49f1-9420-8a85cf0913ce None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:28.564951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-46256ee0-82e1-49f1-9420-8a85cf0913ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:28.567049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:28.664952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 719/1439] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:28.817134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370c7f7-ed51-446f-869d-325be1c0b04b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:28.818698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c370c7f7-ed51-446f-869d-325be1c0b04b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:28.963468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c370c7f7-ed51-446f-869d-325be1c0b04b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:28.990721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:29.075488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6603c62-a4c8-4c33-becc-d5c302becdc4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:29.076129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603c62-a4c8-4c33-becc-d5c302becdc4 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:29.076412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603c62-a4c8-4c33-becc-d5c302becdc4 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:29.076682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6603c62-a4c8-4c33-becc-d5c302becdc4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:29.078347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a6603c62-a4c8-4c33-becc-d5c302becdc4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:29.166312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6603c62-a4c8-4c33-becc-d5c302becdc4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:29.167920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6603c62-a4c8-4c33-becc-d5c302becdc4 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:29.185764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 721/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:31.129488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1cf10-89e9-4ded-9049-0c4094c8bcd3 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:31.130019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1cf10-89e9-4ded-9049-0c4094c8bcd3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:31.130019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d1cf10-89e9-4ded-9049-0c4094c8bcd3 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:31.131441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 720/1441] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:31.136586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f45c-dfc0-492b-8540-8b38dc34dbdd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:31.136999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f45c-dfc0-492b-8540-8b38dc34dbdd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:31.137139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce69f45c-dfc0-492b-8540-8b38dc34dbdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:31.178989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:31.203432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ce69f45c-dfc0-492b-8540-8b38dc34dbdd None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:31.205131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ce69f45c-dfc0-492b-8540-8b38dc34dbdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:31.304212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 722/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:31.344061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1cf10-89e9-4ded-9049-0c4094c8bcd3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:31.346354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b0d1cf10-89e9-4ded-9049-0c4094c8bcd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:31.447943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d1cf10-89e9-4ded-9049-0c4094c8bcd3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:31.480968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:31.521928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-250be334-4d4e-4f5a-833d-ccea41cedc67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:31.522819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250be334-4d4e-4f5a-833d-ccea41cedc67 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:31.523102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250be334-4d4e-4f5a-833d-ccea41cedc67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:31.523379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-250be334-4d4e-4f5a-833d-ccea41cedc67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:31.525028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-250be334-4d4e-4f5a-833d-ccea41cedc67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:31.637694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250be334-4d4e-4f5a-833d-ccea41cedc67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:31.639495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-250be334-4d4e-4f5a-833d-ccea41cedc67 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:31.659768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 721/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:33.885798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bddce-ddf6-4a49-8992-77285ee96f37 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:33.886390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bddce-ddf6-4a49-8992-77285ee96f37 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:33.886390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8bddce-ddf6-4a49-8992-77285ee96f37 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:33.887726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 723/1444] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:33.894264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afbc98-57f5-4864-9c20-31d6a6809b2d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:33.894739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afbc98-57f5-4864-9c20-31d6a6809b2d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:33.894852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03afbc98-57f5-4864-9c20-31d6a6809b2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:33.965590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-03afbc98-57f5-4864-9c20-31d6a6809b2d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:33.966807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-03afbc98-57f5-4864-9c20-31d6a6809b2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:33.980391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:34.071502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 722/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:34.109553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bddce-ddf6-4a49-8992-77285ee96f37 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:34.111147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4c8bddce-ddf6-4a49-8992-77285ee96f37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:34.226065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8bddce-ddf6-4a49-8992-77285ee96f37 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:34.238897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:34.302469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf60a67-d287-40e0-aac9-67d31ce6b756 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:34.303137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60a67-d287-40e0-aac9-67d31ce6b756 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:34.303420 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60a67-d287-40e0-aac9-67d31ce6b756 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:34.303694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf60a67-d287-40e0-aac9-67d31ce6b756 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:34.305383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ccf60a67-d287-40e0-aac9-67d31ce6b756 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:34.427054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf60a67-d287-40e0-aac9-67d31ce6b756 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:34.428557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf60a67-d287-40e0-aac9-67d31ce6b756 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:34.447607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 724/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:36.839053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0444-e788-4f4c-9fb7-182399542bf1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:36.839587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0444-e788-4f4c-9fb7-182399542bf1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:36.839587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06f0444-e788-4f4c-9fb7-182399542bf1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:36.840962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 723/1447] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:36.847083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad364-664e-4d00-9933-b43b191451d6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:36.847569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad364-664e-4d00-9933-b43b191451d6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:36.847677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-172ad364-664e-4d00-9933-b43b191451d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:36.895688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:36.915835 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-172ad364-664e-4d00-9933-b43b191451d6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:36.917035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-172ad364-664e-4d00-9933-b43b191451d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:37.019135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 725/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:37.056619 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0444-e788-4f4c-9fb7-182399542bf1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:37.058224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d06f0444-e788-4f4c-9fb7-182399542bf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:37.169594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06f0444-e788-4f4c-9fb7-182399542bf1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:37.211105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:37.246764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32f4e88c-ed18-415a-84af-4ea7dd255003 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:37.247405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4e88c-ed18-415a-84af-4ea7dd255003 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:37.247686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4e88c-ed18-415a-84af-4ea7dd255003 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:37.247956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32f4e88c-ed18-415a-84af-4ea7dd255003 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:37.249664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-32f4e88c-ed18-415a-84af-4ea7dd255003 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:37.365788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4e88c-ed18-415a-84af-4ea7dd255003 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:37.367278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32f4e88c-ed18-415a-84af-4ea7dd255003 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:37.385894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 724/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:39.572716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d483f1-4e4c-4ad8-8e70-ddb6449913eb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:39.573223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d483f1-4e4c-4ad8-8e70-ddb6449913eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:39.573223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d483f1-4e4c-4ad8-8e70-ddb6449913eb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:39.574592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 726/1450] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:39.580354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3346e-55db-4392-b9fe-a9e0586e0610 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:39.580835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3346e-55db-4392-b9fe-a9e0586e0610 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:39.581110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef3346e-55db-4392-b9fe-a9e0586e0610 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:39.644570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-cef3346e-55db-4392-b9fe-a9e0586e0610 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:39.646416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cef3346e-55db-4392-b9fe-a9e0586e0610 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:39.672976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:39.750232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 725/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:39.789867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d483f1-4e4c-4ad8-8e70-ddb6449913eb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:39.791391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9d483f1-4e4c-4ad8-8e70-ddb6449913eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:39.894178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d483f1-4e4c-4ad8-8e70-ddb6449913eb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:39.914030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:39.972506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0db76f3-d877-4cf8-a5a4-09026f79d133 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:39.973161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db76f3-d877-4cf8-a5a4-09026f79d133 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:39.973471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db76f3-d877-4cf8-a5a4-09026f79d133 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:39.973749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0db76f3-d877-4cf8-a5a4-09026f79d133 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:39.975440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e0db76f3-d877-4cf8-a5a4-09026f79d133 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:40.084533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db76f3-d877-4cf8-a5a4-09026f79d133 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:40.085998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0db76f3-d877-4cf8-a5a4-09026f79d133 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:40.104186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 727/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:42.224882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aff35-9231-433d-b51b-763918d3a9c4 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:42.225512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aff35-9231-433d-b51b-763918d3a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:42.225512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6aff35-9231-433d-b51b-763918d3a9c4 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:42.226848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 726/1453] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:42.232212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c039e-81ba-4bf2-91f4-a0026c2554b9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:42.232639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c039e-81ba-4bf2-91f4-a0026c2554b9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:42.232753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328c039e-81ba-4bf2-91f4-a0026c2554b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:42.295952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:42.299513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-328c039e-81ba-4bf2-91f4-a0026c2554b9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:42.301241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-328c039e-81ba-4bf2-91f4-a0026c2554b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:42.395009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 728/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:42.433760 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aff35-9231-433d-b51b-763918d3a9c4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:42.435322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e6aff35-9231-433d-b51b-763918d3a9c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:42.537645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6aff35-9231-433d-b51b-763918d3a9c4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:42.586117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:42.611226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1dc40-fcd0-454b-9104-0c7c4bc02eea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:42.611893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dc40-fcd0-454b-9104-0c7c4bc02eea service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:42.612174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dc40-fcd0-454b-9104-0c7c4bc02eea service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:42.612446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dc40-fcd0-454b-9104-0c7c4bc02eea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:42.614581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1ce1dc40-fcd0-454b-9104-0c7c4bc02eea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:42.727323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1dc40-fcd0-454b-9104-0c7c4bc02eea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:42.728770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1dc40-fcd0-454b-9104-0c7c4bc02eea service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:42.748507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 727/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:44.827679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced9ac-1307-46bb-ab54-40b6b3c862d2 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:44.828239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced9ac-1307-46bb-ab54-40b6b3c862d2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:44.828239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ced9ac-1307-46bb-ab54-40b6b3c862d2 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:44.830188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 729/1456] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:44.835493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbbe63-7df5-470a-b803-f53c33b3a265 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:44.835931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbbe63-7df5-470a-b803-f53c33b3a265 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:44.836046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adbbe63-7df5-470a-b803-f53c33b3a265 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:44.900134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4adbbe63-7df5-470a-b803-f53c33b3a265 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:44.901641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4adbbe63-7df5-470a-b803-f53c33b3a265 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:44.932329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:45.000121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 728/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:45.042891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced9ac-1307-46bb-ab54-40b6b3c862d2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:45.044471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-56ced9ac-1307-46bb-ab54-40b6b3c862d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:45.150159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ced9ac-1307-46bb-ab54-40b6b3c862d2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:45.179801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:45.224676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78f1597-b49c-417a-8949-4d1987df6036 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:45.225314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f1597-b49c-417a-8949-4d1987df6036 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:45.225621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f1597-b49c-417a-8949-4d1987df6036 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:45.225892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78f1597-b49c-417a-8949-4d1987df6036 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:45.227509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a78f1597-b49c-417a-8949-4d1987df6036 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:45.337649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f1597-b49c-417a-8949-4d1987df6036 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:45.339079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78f1597-b49c-417a-8949-4d1987df6036 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:45.357063 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 730/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:47.460096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6edff-06cc-4ee6-a491-58603dba6d6f None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:47.460618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6edff-06cc-4ee6-a491-58603dba6d6f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:47.460731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c6edff-06cc-4ee6-a491-58603dba6d6f None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:47.462073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 729/1459] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:47.467459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc290b0-ef22-4476-b555-6812e71242a9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:47.467857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc290b0-ef22-4476-b555-6812e71242a9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:47.468018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc290b0-ef22-4476-b555-6812e71242a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:47.533559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2dc290b0-ef22-4476-b555-6812e71242a9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:47.534745 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2dc290b0-ef22-4476-b555-6812e71242a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:47.542764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:47.628392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 731/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:47.666164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6edff-06cc-4ee6-a491-58603dba6d6f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:47.667688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d8c6edff-06cc-4ee6-a491-58603dba6d6f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:47.770848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c6edff-06cc-4ee6-a491-58603dba6d6f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:47.824526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:47.842765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d0d995-8e8a-4bea-81a7-8b50493c9c3e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:47.843405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0d995-8e8a-4bea-81a7-8b50493c9c3e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:47.843682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0d995-8e8a-4bea-81a7-8b50493c9c3e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:47.843951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d0d995-8e8a-4bea-81a7-8b50493c9c3e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:47.846331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c8d0d995-8e8a-4bea-81a7-8b50493c9c3e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:47.952845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0d995-8e8a-4bea-81a7-8b50493c9c3e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:47.954258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d0d995-8e8a-4bea-81a7-8b50493c9c3e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:47.973316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 730/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:50.031903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e5f2-d90f-4966-8416-9e7271f88a9f None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:50.032466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e5f2-d90f-4966-8416-9e7271f88a9f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:50.032466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a2e5f2-d90f-4966-8416-9e7271f88a9f None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:50.034074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 732/1462] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:50.039165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5b04-68b2-4b65-a84b-20359f011391 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:50.039594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5b04-68b2-4b65-a84b-20359f011391 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:50.039755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ef5b04-68b2-4b65-a84b-20359f011391 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:50.103980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-14ef5b04-68b2-4b65-a84b-20359f011391 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:50.105174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-14ef5b04-68b2-4b65-a84b-20359f011391 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:50.143580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:50.203635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 731/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:50.241412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2e5f2-d90f-4966-8416-9e7271f88a9f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:50.242961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-24a2e5f2-d90f-4966-8416-9e7271f88a9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:50.344578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24a2e5f2-d90f-4966-8416-9e7271f88a9f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:50.383527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:50.419975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1eafa1-ebb7-434f-96b6-a953dea57e43 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:50.420617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eafa1-ebb7-434f-96b6-a953dea57e43 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:50.420897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eafa1-ebb7-434f-96b6-a953dea57e43 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:50.421168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1eafa1-ebb7-434f-96b6-a953dea57e43 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:50.422837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cf1eafa1-ebb7-434f-96b6-a953dea57e43 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:50.528539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eafa1-ebb7-434f-96b6-a953dea57e43 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:50.530000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1eafa1-ebb7-434f-96b6-a953dea57e43 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:50.547972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 733/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:52.583321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab35f8-4500-40fe-a930-445c27249f27 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:52.583887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab35f8-4500-40fe-a930-445c27249f27 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:52.583887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ab35f8-4500-40fe-a930-445c27249f27 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:52.585226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 732/1465] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:52.590833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30411470-3bee-494e-8ddc-a57237e8ff7c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:52.591239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30411470-3bee-494e-8ddc-a57237e8ff7c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:52.591384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30411470-3bee-494e-8ddc-a57237e8ff7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:52.655122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-30411470-3bee-494e-8ddc-a57237e8ff7c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:52.656354 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-30411470-3bee-494e-8ddc-a57237e8ff7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:52.674990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:52.751645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 734/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:52.787583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab35f8-4500-40fe-a930-445c27249f27 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:52.789190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-51ab35f8-4500-40fe-a930-445c27249f27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:52.889862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ab35f8-4500-40fe-a930-445c27249f27 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:52.953943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:52.961280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1eb4c29-c62b-4b97-9bff-dec33f7682dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:52.961939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4c29-c62b-4b97-9bff-dec33f7682dd service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:52.962216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4c29-c62b-4b97-9bff-dec33f7682dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:52.962486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1eb4c29-c62b-4b97-9bff-dec33f7682dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:52.964109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e1eb4c29-c62b-4b97-9bff-dec33f7682dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:53.071049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb4c29-c62b-4b97-9bff-dec33f7682dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:53.072475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1eb4c29-c62b-4b97-9bff-dec33f7682dd service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:53.090789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 733/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:30:55.129778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5aef5-07a2-40a2-8115-4654e2f4dbad None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:55.130324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5aef5-07a2-40a2-8115-4654e2f4dbad None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:55.130324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbe5aef5-07a2-40a2-8115-4654e2f4dbad None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:55.131679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 735/1468] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:30:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:30:55.136922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73e8f-e997-449d-9dfa-fa2a3a9cdb66 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:55.137307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73e8f-e997-449d-9dfa-fa2a3a9cdb66 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:55.137523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f73e8f-e997-449d-9dfa-fa2a3a9cdb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:55.203022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c6f73e8f-e997-449d-9dfa-fa2a3a9cdb66 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:30:55.204213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c6f73e8f-e997-449d-9dfa-fa2a3a9cdb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:55.254941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:55.305535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 734/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:30:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:30:55.343272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5aef5-07a2-40a2-8115-4654e2f4dbad None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:30:55.344803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dbe5aef5-07a2-40a2-8115-4654e2f4dbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:55.448626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbe5aef5-07a2-40a2-8115-4654e2f4dbad None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:30:55.495436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:30:55.521309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6fde2b8-7d28-47bc-9a69-ddb10a555fde service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:30:55.521960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fde2b8-7d28-47bc-9a69-ddb10a555fde service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:30:55.522240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fde2b8-7d28-47bc-9a69-ddb10a555fde service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:30:55.522519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6fde2b8-7d28-47bc-9a69-ddb10a555fde service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:30:55.524392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d6fde2b8-7d28-47bc-9a69-ddb10a555fde service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:30:55.638127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fde2b8-7d28-47bc-9a69-ddb10a555fde service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:30:55.639570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6fde2b8-7d28-47bc-9a69-ddb10a555fde service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:30:55.658754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 736/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:30:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 316 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:31:05.303660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=22 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:05.655987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=66 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:15.609103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210901f8-c143-4dea-bbc1-0ff995b31700 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:15.609664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210901f8-c143-4dea-bbc1-0ff995b31700 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:15.609664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-210901f8-c143-4dea-bbc1-0ff995b31700 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:15.611463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 735/1471] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:31:15.616468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7448f-7553-4857-a4b4-7f72fa48ce9f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:15.616894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7448f-7553-4857-a4b4-7f72fa48ce9f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:15.617027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55b7448f-7553-4857-a4b4-7f72fa48ce9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:15.681488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-55b7448f-7553-4857-a4b4-7f72fa48ce9f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:31:15.682701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-55b7448f-7553-4857-a4b4-7f72fa48ce9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:15.781073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 737/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:31:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:31:15.876735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471866e-16bc-4df8-b46f-f6a09cbd4037 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:15.877097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471866e-16bc-4df8-b46f-f6a09cbd4037 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:15.877380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f471866e-16bc-4df8-b46f-f6a09cbd4037 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:15.878848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 736/1473] 10.222.0.20 () {54 vars in 962 bytes} [Tue Jul 12 08:31:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:31:15.883808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20bdca-04e1-4c6f-921e-4aa2b709ebaa None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:15.884098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20bdca-04e1-4c6f-921e-4aa2b709ebaa None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:15.884373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd20bdca-04e1-4c6f-921e-4aa2b709ebaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:15.975218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fd20bdca-04e1-4c6f-921e-4aa2b709ebaa None None] MFA Rules not processed for user `993e107cc04e4ce6b9abd9997c29381f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:31:15.976437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fd20bdca-04e1-4c6f-921e-4aa2b709ebaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:15.998527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:16.073526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 738/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Tue Jul 12 08:31:15 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:31:16.084783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471866e-16bc-4df8-b46f-f6a09cbd4037 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:31:16.088132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f471866e-16bc-4df8-b46f-f6a09cbd4037 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:16.218379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f471866e-16bc-4df8-b46f-f6a09cbd4037 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:31:16.303802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-613ecf04-93c2-4aaf-a9f8-3c4479c3ab36 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993e107cc04e4ce6b9abd9997c29381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:31:16.304915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ecf04-93c2-4aaf-a9f8-3c4479c3ab36 service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:16.305463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ecf04-93c2-4aaf-a9f8-3c4479c3ab36 service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:16.305960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-613ecf04-93c2-4aaf-a9f8-3c4479c3ab36 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:16.308767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-613ecf04-93c2-4aaf-a9f8-3c4479c3ab36 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:16.385172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:16.458252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ecf04-93c2-4aaf-a9f8-3c4479c3ab36 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:31:16.459859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-613ecf04-93c2-4aaf-a9f8-3c4479c3ab36 service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:31:16.483004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 737/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:31:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:31:18.632850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76496-dd91-44cc-a661-f7b59a5c1af7 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:18.633383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76496-dd91-44cc-a661-f7b59a5c1af7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:18.633383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac76496-dd91-44cc-a661-f7b59a5c1af7 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:18.634788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 739/1476] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:31:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:31:18.640068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f89e-1559-443d-817b-0ee3b40c0348 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:18.640469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f89e-1559-443d-817b-0ee3b40c0348 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:18.640622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb2f89e-1559-443d-817b-0ee3b40c0348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:18.704403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fdb2f89e-1559-443d-817b-0ee3b40c0348 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:31:18.706483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fdb2f89e-1559-443d-817b-0ee3b40c0348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:18.803283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 738/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:31:18.827137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac76496-dd91-44cc-a661-f7b59a5c1af7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:31:18.828643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5ac76496-dd91-44cc-a661-f7b59a5c1af7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:18.952148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac76496-dd91-44cc-a661-f7b59a5c1af7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:31:19.000175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:19.044156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7555264c-3dbf-4a08-a8a1-2bbbecf81f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:31:19.044806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555264c-3dbf-4a08-a8a1-2bbbecf81f3f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:19.045084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555264c-3dbf-4a08-a8a1-2bbbecf81f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:19.045355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7555264c-3dbf-4a08-a8a1-2bbbecf81f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:19.046117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555264c-3dbf-4a08-a8a1-2bbbecf81f3f admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:31:19.047902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-7555264c-3dbf-4a08-a8a1-2bbbecf81f3f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:31:19.047902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: warnings.warn(msg) Jul 12 08:31:19.047902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: Jul 12 08:31:19.049869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7555264c-3dbf-4a08-a8a1-2bbbecf81f3f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:31:19.068196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 740/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Tue Jul 12 08:31:18 2022] GET /identity/v3/projects => generated 2553 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:31:21.130458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0578ed1-31ed-4536-ab39-51b510868e88 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:21.131024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0578ed1-31ed-4536-ab39-51b510868e88 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:21.131024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0578ed1-31ed-4536-ab39-51b510868e88 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:21.132364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 739/1479] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:31:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:31:21.137549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9a34-7ec3-40f5-8290-ae452543e215 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:21.137984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9a34-7ec3-40f5-8290-ae452543e215 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:21.138112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1da9a34-7ec3-40f5-8290-ae452543e215 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:21.203069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f1da9a34-7ec3-40f5-8290-ae452543e215 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:31:21.204274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f1da9a34-7ec3-40f5-8290-ae452543e215 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:21.300781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 741/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:31:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:31:21.344225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0578ed1-31ed-4536-ab39-51b510868e88 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:31:21.345799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f0578ed1-31ed-4536-ab39-51b510868e88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:21.355502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:21.494020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0578ed1-31ed-4536-ab39-51b510868e88 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:31:21.575218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:21.608314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2254e745-fd54-461c-a521-5f5f40ecdc3b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:31:21.608956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e745-fd54-461c-a521-5f5f40ecdc3b service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:21.609237 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e745-fd54-461c-a521-5f5f40ecdc3b service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:21.609537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2254e745-fd54-461c-a521-5f5f40ecdc3b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:21.612265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2254e745-fd54-461c-a521-5f5f40ecdc3b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:21.700557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254e745-fd54-461c-a521-5f5f40ecdc3b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:31:21.702100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2254e745-fd54-461c-a521-5f5f40ecdc3b service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:31:21.719765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 740/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:31:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:31:23.952056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8841b-ff45-4f88-8a03-de8be04645c1 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:23.952600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8841b-ff45-4f88-8a03-de8be04645c1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:23.952600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e8841b-ff45-4f88-8a03-de8be04645c1 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:23.954044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 742/1482] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:31:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:31:23.959956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9dc8d-27e1-42e9-8ca3-e978e1927397 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:23.960403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9dc8d-27e1-42e9-8ca3-e978e1927397 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:23.960524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3be9dc8d-27e1-42e9-8ca3-e978e1927397 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:24.025262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3be9dc8d-27e1-42e9-8ca3-e978e1927397 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:31:24.026502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3be9dc8d-27e1-42e9-8ca3-e978e1927397 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:24.073502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:24.124985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 741/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:31:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:31:24.164645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8841b-ff45-4f88-8a03-de8be04645c1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:31:24.166228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5e8841b-ff45-4f88-8a03-de8be04645c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:24.190798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:24.269586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e8841b-ff45-4f88-8a03-de8be04645c1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:31:24.340732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a70bc31a-f670-4e0a-ac68-bfb1e95ef559 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:31:24.341369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc31a-f670-4e0a-ac68-bfb1e95ef559 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:24.341682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc31a-f670-4e0a-ac68-bfb1e95ef559 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:24.341955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70bc31a-f670-4e0a-ac68-bfb1e95ef559 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:24.343589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a70bc31a-f670-4e0a-ac68-bfb1e95ef559 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:24.418636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:24.454891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bc31a-f670-4e0a-ac68-bfb1e95ef559 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:31:24.456363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a70bc31a-f670-4e0a-ac68-bfb1e95ef559 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:31:24.473926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 743/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:31:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:31:26.624344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988bccf-9324-49a8-a84c-fb0eb9c1e2a6 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:26.624847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988bccf-9324-49a8-a84c-fb0eb9c1e2a6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:26.624847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5988bccf-9324-49a8-a84c-fb0eb9c1e2a6 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:26.626228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 742/1485] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:31:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:31:26.631995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a50ae-30fb-4271-b1b5-ba38bfa4d5f1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:26.632422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a50ae-30fb-4271-b1b5-ba38bfa4d5f1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:26.632557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92a50ae-30fb-4271-b1b5-ba38bfa4d5f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:26.696667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a92a50ae-30fb-4271-b1b5-ba38bfa4d5f1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:31:26.697896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a92a50ae-30fb-4271-b1b5-ba38bfa4d5f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:26.790901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 744/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:31:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:31:26.828703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988bccf-9324-49a8-a84c-fb0eb9c1e2a6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:31:26.830300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5988bccf-9324-49a8-a84c-fb0eb9c1e2a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:26.931471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5988bccf-9324-49a8-a84c-fb0eb9c1e2a6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:31:27.000940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:27.003412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa1810eb-31cf-448f-87ad-2f3f297b5f31 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:31:27.004055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1810eb-31cf-448f-87ad-2f3f297b5f31 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:27.004526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1810eb-31cf-448f-87ad-2f3f297b5f31 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:27.004975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa1810eb-31cf-448f-87ad-2f3f297b5f31 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:27.006994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fa1810eb-31cf-448f-87ad-2f3f297b5f31 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:27.115045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1810eb-31cf-448f-87ad-2f3f297b5f31 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:31:27.116483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa1810eb-31cf-448f-87ad-2f3f297b5f31 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:31:27.135203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 743/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:31:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:31:29.265075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088eeb8-9d58-45d6-9080-8085258bbb3b None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:29.265671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088eeb8-9d58-45d6-9080-8085258bbb3b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:29.265671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c088eeb8-9d58-45d6-9080-8085258bbb3b None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:29.267581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 745/1488] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:31:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:31:29.272912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902ac82-8b1f-46ae-a4c7-f2d563ca1783 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:29.273367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902ac82-8b1f-46ae-a4c7-f2d563ca1783 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:29.273487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2902ac82-8b1f-46ae-a4c7-f2d563ca1783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:29.337668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2902ac82-8b1f-46ae-a4c7-f2d563ca1783 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:31:29.338874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2902ac82-8b1f-46ae-a4c7-f2d563ca1783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:29.390506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:29.436636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 744/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:31:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:31:29.478103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088eeb8-9d58-45d6-9080-8085258bbb3b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:31:29.479630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c088eeb8-9d58-45d6-9080-8085258bbb3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:29.520195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:29.587023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c088eeb8-9d58-45d6-9080-8085258bbb3b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:31:29.659181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f343fceb-f095-46bf-b78c-0c2fa32819cc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:31:29.659863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343fceb-f095-46bf-b78c-0c2fa32819cc service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:29.660146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343fceb-f095-46bf-b78c-0c2fa32819cc service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:29.660422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f343fceb-f095-46bf-b78c-0c2fa32819cc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:29.662140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f343fceb-f095-46bf-b78c-0c2fa32819cc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:29.740769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:29.769749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343fceb-f095-46bf-b78c-0c2fa32819cc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:31:29.771257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f343fceb-f095-46bf-b78c-0c2fa32819cc service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:31:29.790455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 746/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:31:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 313 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:31:32.010792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3056-d0a6-4f39-b722-56785447dfc8 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:32.011355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3056-d0a6-4f39-b722-56785447dfc8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:32.011355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab3056-d0a6-4f39-b722-56785447dfc8 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:32.012653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 745/1491] 10.222.0.20 () {54 vars in 926 bytes} [Tue Jul 12 08:31:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:31:32.018423 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17024262-1d47-4208-9c30-40b3d2a2d724 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:32.018859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17024262-1d47-4208-9c30-40b3d2a2d724 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:32.018968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17024262-1d47-4208-9c30-40b3d2a2d724 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:32.082379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-17024262-1d47-4208-9c30-40b3d2a2d724 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:31:32.083572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-17024262-1d47-4208-9c30-40b3d2a2d724 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:32.182557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 747/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Tue Jul 12 08:31:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:31:32.226916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab3056-d0a6-4f39-b722-56785447dfc8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:31:32.228467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-78ab3056-d0a6-4f39-b722-56785447dfc8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:32.333240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ab3056-d0a6-4f39-b722-56785447dfc8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:31:32.404400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e662b8c8-3dce-4d04-a889-f84f00937c14 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:31:32.405029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662b8c8-3dce-4d04-a889-f84f00937c14 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:31:32.405305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662b8c8-3dce-4d04-a889-f84f00937c14 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:31:32.405603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e662b8c8-3dce-4d04-a889-f84f00937c14 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:31:32.407226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e662b8c8-3dce-4d04-a889-f84f00937c14 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:31:32.416644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:32.513779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662b8c8-3dce-4d04-a889-f84f00937c14 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:31:32.515213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e662b8c8-3dce-4d04-a889-f84f00937c14 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:31:32.533832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 746/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:31:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:31:42.179820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=82 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:31:42.531292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=50 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:32:58.460497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f68d9-f259-4876-8061-f438f9021a08 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:58.460993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f68d9-f259-4876-8061-f438f9021a08 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:58.461096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e25f68d9-f259-4876-8061-f438f9021a08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:58.536811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e25f68d9-f259-4876-8061-f438f9021a08 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:32:58.538035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e25f68d9-f259-4876-8061-f438f9021a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:32:58.632272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 748/1494] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:32:58.640222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43345c-97e3-430c-a98b-0d03269d1024 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:58.640720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43345c-97e3-430c-a98b-0d03269d1024 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:58.640829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c43345c-97e3-430c-a98b-0d03269d1024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:58.717268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4c43345c-97e3-430c-a98b-0d03269d1024 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:32:58.718507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4c43345c-97e3-430c-a98b-0d03269d1024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:32:58.812440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 747/1495] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:32:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:32:58.817627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f68d9-f259-4876-8061-f438f9021a08 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:32:58.818830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e25f68d9-f259-4876-8061-f438f9021a08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:32:58.830685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e25f68d9-f259-4876-8061-f438f9021a08 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:32:58.894315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:32:58.928763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:32:58.929348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:58.929659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:58.929939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:58.930677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:32:58.930980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:32:58.931988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:32:58.931988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: warnings.warn(msg) Jul 12 08:32:58.931988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: Jul 12 08:32:58.932877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:32:58.944626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 749/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:32:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:32:58.952701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43345c-97e3-430c-a98b-0d03269d1024 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:32:58.962462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c43345c-97e3-430c-a98b-0d03269d1024 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:32:59.023019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:32:59.057679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:32:59.058330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:59.058610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:59.058882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:59.059574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:32:59.061292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:32:59.061292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 12 08:32:59.061292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: Jul 12 08:32:59.062497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:32:59.115910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 748/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:32:58 2022] POST /identity/v3/projects => generated 377 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:32:59.120003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:32:59.121552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:32:59.155779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c1aa1a-00ce-4c8f-a114-709cfdd174b1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:32:59.249129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:32:59.249740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:59.250024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:59.250297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:59.251764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:32:59.252774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:32:59.252774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: warnings.warn(msg) Jul 12 08:32:59.252774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: Jul 12 08:32:59.254015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:32:59.292903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 750/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:32:59 2022] POST /identity/v3/users => generated 289 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:32:59.297139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:32:59.299215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:32:59.359486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1572628c-a694-4c1d-b14b-8fdd133f9312 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:32:59.443656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:32:59.454623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:32:59.455287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:59.455567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:59.455832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:59.456556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:32:59.457603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:32:59.457603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 12 08:32:59.457603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: Jul 12 08:32:59.458478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:32:59.471865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 749/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:32:59.475975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:32:59.477604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:32:59.489660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41fa64e-8054-46a2-b8d4-6f672ba06618 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:32:59.514447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:32:59.585503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c92141-42fa-44ac-ad50-6b64de44f2bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:32:59.586171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92141-42fa-44ac-ad50-6b64de44f2bb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:59.586453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92141-42fa-44ac-ad50-6b64de44f2bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:59.586725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c92141-42fa-44ac-ad50-6b64de44f2bb admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:59.587436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92141-42fa-44ac-ad50-6b64de44f2bb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:32:59.588456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-49c92141-42fa-44ac-ad50-6b64de44f2bb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:32:59.588456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: warnings.warn(msg) Jul 12 08:32:59.588456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: Jul 12 08:32:59.589326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c92141-42fa-44ac-ad50-6b64de44f2bb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:32:59.602374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 751/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:32:59 2022] GET /identity/v3/roles => generated 1420 bytes in 127 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:32:59.606522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:32:59.608136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:32:59.641372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae58dc1-1546-4704-9501-fd613861ce5f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:32:59.737110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63c7287-1e63-4cda-8aa0-83b4ca189109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:32:59.738067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c7287-1e63-4cda-8aa0-83b4ca189109 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:59.738348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c7287-1e63-4cda-8aa0-83b4ca189109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:59.738621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63c7287-1e63-4cda-8aa0-83b4ca189109 admin admin] PATH_INFO: `/v3/projects/5fe42147597f45fcaec7901150d95c8e/users/69d19ecdfe8449b6990d92e4582d9162/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:59.760893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c7287-1e63-4cda-8aa0-83b4ca189109 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5fe42147597f45fcaec7901150d95c8e, user_id=69d19ecdfe8449b6990d92e4582d9162, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:32:59.761967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-f63c7287-1e63-4cda-8aa0-83b4ca189109 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:32:59.761967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 12 08:32:59.761967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: Jul 12 08:32:59.763961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63c7287-1e63-4cda-8aa0-83b4ca189109 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:32:59.788887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 750/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:32:59 2022] PUT /identity/v3/projects/5fe42147597f45fcaec7901150d95c8e/users/69d19ecdfe8449b6990d92e4582d9162/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:32:59.801210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd109-c162-4e6a-8a3b-4116de3a04b0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:59.801538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd109-c162-4e6a-8a3b-4116de3a04b0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:59.801820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9dd109-c162-4e6a-8a3b-4116de3a04b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:59.857623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5e9dd109-c162-4e6a-8a3b-4116de3a04b0 None None] MFA Rules not processed for user `69d19ecdfe8449b6990d92e4582d9162`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:32:59.858831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5e9dd109-c162-4e6a-8a3b-4116de3a04b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:32:59.935278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 752/1502] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:32:59 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:32:59.948177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0a5d-8e55-4019-a92b-a559cb629437 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:59.948469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0a5d-8e55-4019-a92b-a559cb629437 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:59.948747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-797a0a5d-8e55-4019-a92b-a559cb629437 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:59.950183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 751/1503] 10.222.0.20 () {54 vars in 963 bytes} [Tue Jul 12 08:32:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:32:59.955552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130b9a-0331-45d3-84a7-2075ab353d00 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:32:59.955839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130b9a-0331-45d3-84a7-2075ab353d00 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:32:59.956109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1130b9a-0331-45d3-84a7-2075ab353d00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:32:59.985410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:33:00.030592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b1130b9a-0331-45d3-84a7-2075ab353d00 None None] MFA Rules not processed for user `91d8f3d11ef745d988fa2749f2a885ee`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:33:00.031807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b1130b9a-0331-45d3-84a7-2075ab353d00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:33:00.227203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 753/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Tue Jul 12 08:32:59 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 273 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:33:00.234754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0a5d-8e55-4019-a92b-a559cb629437 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:33:00.236733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-797a0a5d-8e55-4019-a92b-a559cb629437 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:33:00.286367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:33:00.340926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-797a0a5d-8e55-4019-a92b-a559cb629437 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:33:00.412742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:33:00.413397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:33:00.413711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:33:00.413987 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:33:00.415647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:33:00.513793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:33:00.515136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:33:00.518673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:33:00.534097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 752/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:33:00 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:33:00.577020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3b8dd-6ac3-447c-8547-68a80f9f86be None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:33:00.577490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3b8dd-6ac3-447c-8547-68a80f9f86be None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:33:00.577589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64a3b8dd-6ac3-447c-8547-68a80f9f86be None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:33:00.578847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 754/1506] 10.222.0.20 () {52 vars in 829 bytes} [Tue Jul 12 08:33:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:33:00.582846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:33:00.584063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:33:00.680787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e91bf22c-91b8-4182-b69a-9942d47375d2 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:33:00.774275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:33:00.775146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:33:00.775425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:33:00.775700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] PATH_INFO: `/v3/users/69d19ecdfe8449b6990d92e4582d9162` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:33:00.788377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] RBAC: Authorizing `identity:delete_user(user_id=69d19ecdfe8449b6990d92e4582d9162)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:33:00.789444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:33:00.789444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 12 08:33:00.789444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: Jul 12 08:33:00.790652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:33:00.801025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:33:00.854419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69d19ecdfe8449b6990d92e4582d9162'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:00.866593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69d19ecdfe8449b6990d92e4582d9162'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:00.875273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69d19ecdfe8449b6990d92e4582d9162'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:00.896034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69d19ecdfe8449b6990d92e4582d9162'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:00.896560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69d19ecdfe8449b6990d92e4582d9162'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:00.902301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 753/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:33:00 2022] DELETE /identity/v3/users/69d19ecdfe8449b6990d92e4582d9162 => generated 0 bytes in 320 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:33:00.906864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467436d-f27b-469d-b7ab-ce2d30b3b1ee None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:33:00.907686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467436d-f27b-469d-b7ab-ce2d30b3b1ee None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:33:00.907958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467436d-f27b-469d-b7ab-ce2d30b3b1ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:33:00.960763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d467436d-f27b-469d-b7ab-ce2d30b3b1ee None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:33:00.962014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d467436d-f27b-469d-b7ab-ce2d30b3b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:33:01.035115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:33:01.047786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 755/1508] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:33:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:33:01.057821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:33:01.059077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:33:01.158188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f20d8206-802a-4e69-8bc1-4af14ee69379 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:33:01.212527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:33:01.232861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79009611-b4b3-4888-8712-f887177e3ba8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:33:01.233531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79009611-b4b3-4888-8712-f887177e3ba8 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:33:01.233818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79009611-b4b3-4888-8712-f887177e3ba8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:33:01.234091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79009611-b4b3-4888-8712-f887177e3ba8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:33:01.236312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-79009611-b4b3-4888-8712-f887177e3ba8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:33:01.342059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79009611-b4b3-4888-8712-f887177e3ba8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:33:01.342754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79009611-b4b3-4888-8712-f887177e3ba8 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:33:01.363310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 754/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:33:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:33:01.698376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467436d-f27b-469d-b7ab-ce2d30b3b1ee None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:33:01.699596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d467436d-f27b-469d-b7ab-ce2d30b3b1ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:33:01.712135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467436d-f27b-469d-b7ab-ce2d30b3b1ee None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:33:01.807590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:33:01.808451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:33:01.808735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:33:01.809011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] PATH_INFO: `/v3/projects/5fe42147597f45fcaec7901150d95c8e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:33:01.819960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5fe42147597f45fcaec7901150d95c8e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:33:01.820977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:33:01.820977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: warnings.warn(msg) Jul 12 08:33:01.820977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: Jul 12 08:33:01.822199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:33:01.878768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5fe42147597f45fcaec7901150d95c8e', 'request_id': 'req-0bc809c5-1336-412e-b15c-d6386a33d597'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:01.884875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5fe42147597f45fcaec7901150d95c8e', 'request_id': 'req-0bc809c5-1336-412e-b15c-d6386a33d597'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:01.895023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5fe42147597f45fcaec7901150d95c8e', 'request_id': 'req-0bc809c5-1336-412e-b15c-d6386a33d597'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:01.927130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] The token cache is being invalidate because project 5fe42147597f45fcaec7901150d95c8e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:33:01.927416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:01.927834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0bc809c5-1336-412e-b15c-d6386a33d597 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:33:01.929268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 756/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:33:01 2022] DELETE /identity/v3/projects/5fe42147597f45fcaec7901150d95c8e => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:33:11.360453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=62 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:33:11.925224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:34:39.733408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767f00-7c4d-4492-b9b8-7f4d5a28d7b1 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:39.734005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767f00-7c4d-4492-b9b8-7f4d5a28d7b1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:39.734005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9767f00-7c4d-4492-b9b8-7f4d5a28d7b1 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:39.735265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 755/1511] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:34:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:34:39.740530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b92c-e063-49cc-8d53-4ec4a4ee84b3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:39.740982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b92c-e063-49cc-8d53-4ec4a4ee84b3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:39.741086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca3b92c-e063-49cc-8d53-4ec4a4ee84b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:39.817713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4ca3b92c-e063-49cc-8d53-4ec4a4ee84b3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:34:39.818904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4ca3b92c-e063-49cc-8d53-4ec4a4ee84b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:39.917597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 757/1512] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:34:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:34:40.074816 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9767f00-7c4d-4492-b9b8-7f4d5a28d7b1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:34:40.076927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f9767f00-7c4d-4492-b9b8-7f4d5a28d7b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:40.193477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9767f00-7c4d-4492-b9b8-7f4d5a28d7b1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:34:40.198999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1571b6-0caf-4027-9b8e-aa50323b0449 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:34:40.199675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1571b6-0caf-4027-9b8e-aa50323b0449 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:40.199955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1571b6-0caf-4027-9b8e-aa50323b0449 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:40.200226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1571b6-0caf-4027-9b8e-aa50323b0449 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:40.209965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1571b6-0caf-4027-9b8e-aa50323b0449 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:34:40.211573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1571b6-0caf-4027-9b8e-aa50323b0449 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:34:40.222373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 756/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:34:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:34:41.056717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e0528-c685-43dc-a30d-7bc7eb2c5c44 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:41.057298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e0528-c685-43dc-a30d-7bc7eb2c5c44 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:41.057298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c26e0528-c685-43dc-a30d-7bc7eb2c5c44 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:41.058735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 758/1514] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:34:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:34:41.063377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059059-e7a3-4a5a-8c66-4fa978322aa0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:41.063768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059059-e7a3-4a5a-8c66-4fa978322aa0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:41.063931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2059059-e7a3-4a5a-8c66-4fa978322aa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:41.083223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b2059059-e7a3-4a5a-8c66-4fa978322aa0 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:34:41.084479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b2059059-e7a3-4a5a-8c66-4fa978322aa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:41.092527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 757/1515] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:34:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:34:41.242830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e0528-c685-43dc-a30d-7bc7eb2c5c44 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:34:41.257386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c26e0528-c685-43dc-a30d-7bc7eb2c5c44 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:34:41.262727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96273a23-220b-4ed9-8802-c62f3c7b70db service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:34:41.263355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273a23-220b-4ed9-8802-c62f3c7b70db service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:41.263726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273a23-220b-4ed9-8802-c62f3c7b70db service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:41.264003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96273a23-220b-4ed9-8802-c62f3c7b70db service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:41.272488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96273a23-220b-4ed9-8802-c62f3c7b70db service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:34:41.274090 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96273a23-220b-4ed9-8802-c62f3c7b70db service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:34:41.283453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 759/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:34:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:34:41.581164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264508a8-8905-4470-b4e0-94090c7590dc None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:41.581360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264508a8-8905-4470-b4e0-94090c7590dc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:41.581662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264508a8-8905-4470-b4e0-94090c7590dc None None] PATH_INFO: `/v3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:41.582982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 758/1517] 10.222.0.25 () {54 vars in 925 bytes} [Tue Jul 12 08:34:41 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:34:41.589312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ab69-15cc-4d03-bfff-a07826bdd52a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:41.589629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ab69-15cc-4d03-bfff-a07826bdd52a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:41.589911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea9ab69-15cc-4d03-bfff-a07826bdd52a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:41.647729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-fea9ab69-15cc-4d03-bfff-a07826bdd52a None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:34:41.648923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fea9ab69-15cc-4d03-bfff-a07826bdd52a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:41.665670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:34:41.722742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 760/1518] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Jul 12 08:34:41 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:34:50.735823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f629e6-2820-46af-be4d-3ef668df4b11 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:50.736367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f629e6-2820-46af-be4d-3ef668df4b11 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:50.736367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f629e6-2820-46af-be4d-3ef668df4b11 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:50.737699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 759/1519] 10.222.0.20 () {54 vars in 960 bytes} [Tue Jul 12 08:34:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:34:50.742800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a20f-3798-4090-a549-dd92814cf70c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:50.743229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a20f-3798-4090-a549-dd92814cf70c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:50.743507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a05a20f-3798-4090-a549-dd92814cf70c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:50.760781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6a05a20f-3798-4090-a549-dd92814cf70c None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:34:50.761996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6a05a20f-3798-4090-a549-dd92814cf70c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:50.770231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 761/1520] 10.222.0.20 () {58 vars in 1057 bytes} [Tue Jul 12 08:34:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:34:50.778393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f629e6-2820-46af-be4d-3ef668df4b11 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:34:50.792060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8f629e6-2820-46af-be4d-3ef668df4b11 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:34:50.796929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b195e1d8-4a18-422e-b4e1-e4c5a18de016 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:34:50.797589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195e1d8-4a18-422e-b4e1-e4c5a18de016 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:50.797867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195e1d8-4a18-422e-b4e1-e4c5a18de016 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:50.798140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b195e1d8-4a18-422e-b4e1-e4c5a18de016 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:50.806395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195e1d8-4a18-422e-b4e1-e4c5a18de016 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:34:50.807980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b195e1d8-4a18-422e-b4e1-e4c5a18de016 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:34:50.817448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 760/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:34:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:34:52.502314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b727-9aa0-4d51-801e-9a5a31e8ce54 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:52.502833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b727-9aa0-4d51-801e-9a5a31e8ce54 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:52.502927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8714b727-9aa0-4d51-801e-9a5a31e8ce54 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:52.504227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 762/1522] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:34:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:34:52.509017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89a577-4d6e-43c4-afef-1e8bd6d9ec19 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:52.509493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89a577-4d6e-43c4-afef-1e8bd6d9ec19 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:52.509591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d89a577-4d6e-43c4-afef-1e8bd6d9ec19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:52.528396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2d89a577-4d6e-43c4-afef-1e8bd6d9ec19 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:34:52.529624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2d89a577-4d6e-43c4-afef-1e8bd6d9ec19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:52.537963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 761/1523] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:34:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:34:52.692212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714b727-9aa0-4d51-801e-9a5a31e8ce54 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:34:52.706392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8714b727-9aa0-4d51-801e-9a5a31e8ce54 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:34:52.711746 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aba67c3-6280-4995-8d2a-0119904cfcd5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:34:52.712375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba67c3-6280-4995-8d2a-0119904cfcd5 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:52.712658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba67c3-6280-4995-8d2a-0119904cfcd5 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:52.712936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aba67c3-6280-4995-8d2a-0119904cfcd5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:52.721203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba67c3-6280-4995-8d2a-0119904cfcd5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:34:52.722907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aba67c3-6280-4995-8d2a-0119904cfcd5 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:34:52.732901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 763/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:34:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:34:53.557350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c6f2-9dac-4563-8a44-14018ceb6cf9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:53.558010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c6f2-9dac-4563-8a44-14018ceb6cf9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:53.558010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2066c6f2-9dac-4563-8a44-14018ceb6cf9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:53.559324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 762/1525] 127.0.0.1 () {54 vars in 901 bytes} [Tue Jul 12 08:34:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:34:53.563964 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8cd83-caac-419a-b498-139bebd940eb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:53.564363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8cd83-caac-419a-b498-139bebd940eb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:53.564506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11f8cd83-caac-419a-b498-139bebd940eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:53.583001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-11f8cd83-caac-419a-b498-139bebd940eb None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:34:53.584760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-11f8cd83-caac-419a-b498-139bebd940eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:53.592528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 764/1526] 127.0.0.1 () {58 vars in 998 bytes} [Tue Jul 12 08:34:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:34:53.744102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066c6f2-9dac-4563-8a44-14018ceb6cf9 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:34:53.758078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2066c6f2-9dac-4563-8a44-14018ceb6cf9 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:34:53.763377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ce58de-6e42-4d76-9880-14a0b4bbca7e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:34:53.763997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce58de-6e42-4d76-9880-14a0b4bbca7e service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:53.764270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce58de-6e42-4d76-9880-14a0b4bbca7e service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:53.764537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ce58de-6e42-4d76-9880-14a0b4bbca7e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:53.772874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce58de-6e42-4d76-9880-14a0b4bbca7e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:34:53.774471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ce58de-6e42-4d76-9880-14a0b4bbca7e service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:34:53.783762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 763/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:34:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:34:57.626462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0646a2-237b-451a-9bce-276f160091b4 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:57.627025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0646a2-237b-451a-9bce-276f160091b4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:57.627025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b0646a2-237b-451a-9bce-276f160091b4 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:57.628378 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 765/1528] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:34:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:34:57.634520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd54a05-15c9-40fb-951b-53526b516f81 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:57.634921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd54a05-15c9-40fb-951b-53526b516f81 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:57.635088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecd54a05-15c9-40fb-951b-53526b516f81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:57.652677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ecd54a05-15c9-40fb-951b-53526b516f81 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:34:57.654144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ecd54a05-15c9-40fb-951b-53526b516f81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:57.662387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 764/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:34:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:34:57.734367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0646a2-237b-451a-9bce-276f160091b4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:34:57.736093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8b0646a2-237b-451a-9bce-276f160091b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:57.813948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b0646a2-237b-451a-9bce-276f160091b4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:34:57.817611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f47f651-f2fd-4818-9bd9-b84722e4040b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:34:57.818263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f651-f2fd-4818-9bd9-b84722e4040b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:57.818547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f651-f2fd-4818-9bd9-b84722e4040b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:57.818822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f47f651-f2fd-4818-9bd9-b84722e4040b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:57.827551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47f651-f2fd-4818-9bd9-b84722e4040b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:34:57.828969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f47f651-f2fd-4818-9bd9-b84722e4040b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:34:57.838308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 766/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:34:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:34:59.858761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312ee50-196f-465a-baaf-42d6f19b14de None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:59.859324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312ee50-196f-465a-baaf-42d6f19b14de None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:59.859324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c312ee50-196f-465a-baaf-42d6f19b14de None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:59.860715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 765/1531] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:34:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:34:59.866666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb78c-96ee-4bbb-9fe8-d536db3a39a1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:59.867065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb78c-96ee-4bbb-9fe8-d536db3a39a1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:59.867221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c8cb78c-96ee-4bbb-9fe8-d536db3a39a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:59.885246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3c8cb78c-96ee-4bbb-9fe8-d536db3a39a1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:34:59.886465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3c8cb78c-96ee-4bbb-9fe8-d536db3a39a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:34:59.894397 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 767/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:34:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:34:59.931400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312ee50-196f-465a-baaf-42d6f19b14de None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:34:59.942046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c312ee50-196f-465a-baaf-42d6f19b14de None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:34:59.945440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ea181b6-4d0c-45bf-8ac1-5e6dea16f0c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:34:59.946065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea181b6-4d0c-45bf-8ac1-5e6dea16f0c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:34:59.946342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea181b6-4d0c-45bf-8ac1-5e6dea16f0c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:34:59.946613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ea181b6-4d0c-45bf-8ac1-5e6dea16f0c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:34:59.955211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea181b6-4d0c-45bf-8ac1-5e6dea16f0c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:34:59.956649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ea181b6-4d0c-45bf-8ac1-5e6dea16f0c6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:34:59.966117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 766/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:34:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:35:03.491563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27668-d866-4753-9c63-f445fb77b048 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:35:03.492050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27668-d866-4753-9c63-f445fb77b048 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:35:03.492156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7de27668-d866-4753-9c63-f445fb77b048 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:35:03.493475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 768/1534] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:35:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:35:03.498486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5cf7-6b5e-4aeb-8e00-0ae560efebda None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:35:03.498898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5cf7-6b5e-4aeb-8e00-0ae560efebda None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:35:03.499033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f26f5cf7-6b5e-4aeb-8e00-0ae560efebda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:35:03.505247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=81 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:35:03.517882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f26f5cf7-6b5e-4aeb-8e00-0ae560efebda None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:35:03.519093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f26f5cf7-6b5e-4aeb-8e00-0ae560efebda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:35:03.527324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 767/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:35:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:35:03.831892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de27668-d866-4753-9c63-f445fb77b048 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:35:03.833605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7de27668-d866-4753-9c63-f445fb77b048 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:35:03.900929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:35:03.915423 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7de27668-d866-4753-9c63-f445fb77b048 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:35:03.919003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce832e7-1ca0-4792-a5d4-7f0ae9ab32de service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:35:03.919649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce832e7-1ca0-4792-a5d4-7f0ae9ab32de service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:35:03.919930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce832e7-1ca0-4792-a5d4-7f0ae9ab32de service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:35:03.920205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce832e7-1ca0-4792-a5d4-7f0ae9ab32de service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:35:03.929775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce832e7-1ca0-4792-a5d4-7f0ae9ab32de service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:35:03.931209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce832e7-1ca0-4792-a5d4-7f0ae9ab32de service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:35:03.940440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 769/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:35:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:35:05.988112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6989a0d-a4d7-4fef-b9de-3111c12c123d None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:35:05.988709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6989a0d-a4d7-4fef-b9de-3111c12c123d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:35:05.988709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6989a0d-a4d7-4fef-b9de-3111c12c123d None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:35:05.990175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 768/1537] 127.0.0.1 () {54 vars in 916 bytes} [Tue Jul 12 08:35:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:35:05.995947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524ef37-a677-4a81-a272-8e03227c8a9e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:35:05.996374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524ef37-a677-4a81-a272-8e03227c8a9e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:35:05.996508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524ef37-a677-4a81-a272-8e03227c8a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:35:06.014703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7524ef37-a677-4a81-a272-8e03227c8a9e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:35:06.015916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7524ef37-a677-4a81-a272-8e03227c8a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:35:06.023899 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 770/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Tue Jul 12 08:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:35:06.327130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6989a0d-a4d7-4fef-b9de-3111c12c123d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:35:06.328787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f6989a0d-a4d7-4fef-b9de-3111c12c123d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:35:06.342427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6989a0d-a4d7-4fef-b9de-3111c12c123d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:35:06.345909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daec2dec-a7f6-484f-8cf8-eb48f51e3bb1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:35:06.346531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2dec-a7f6-484f-8cf8-eb48f51e3bb1 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:35:06.346807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2dec-a7f6-484f-8cf8-eb48f51e3bb1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:35:06.347077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daec2dec-a7f6-484f-8cf8-eb48f51e3bb1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:35:06.356521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec2dec-a7f6-484f-8cf8-eb48f51e3bb1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:35:06.357995 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daec2dec-a7f6-484f-8cf8-eb48f51e3bb1 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:35:06.367495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 769/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:35:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:35:16.009837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=11 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:35:16.363123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=8 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:33.911446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a72e5-dbd1-42e5-850c-6644c2dda577 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:33.912145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a72e5-dbd1-42e5-850c-6644c2dda577 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:33.912145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a6a72e5-dbd1-42e5-850c-6644c2dda577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:33.936327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5a6a72e5-dbd1-42e5-850c-6644c2dda577 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:33.937590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5a6a72e5-dbd1-42e5-850c-6644c2dda577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:33.946930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 771/1540] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:33.956308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb970d8-b7aa-425c-b67b-3c1eafa7c86f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:33.956902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb970d8-b7aa-425c-b67b-3c1eafa7c86f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:33.956902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbb970d8-b7aa-425c-b67b-3c1eafa7c86f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:33.980889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bbb970d8-b7aa-425c-b67b-3c1eafa7c86f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:33.982183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bbb970d8-b7aa-425c-b67b-3c1eafa7c86f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:33.996028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 770/1541] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.001630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a72e5-dbd1-42e5-850c-6644c2dda577 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.017407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a6a72e5-dbd1-42e5-850c-6644c2dda577 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.022450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.023318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.023424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.023654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.025571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:34.025571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.026725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.042564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 772/1542] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:34.051413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb970d8-b7aa-425c-b67b-3c1eafa7c86f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.063534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbb970d8-b7aa-425c-b67b-3c1eafa7c86f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.078676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0ef5c2d-7357-425b-a2ab-2bc192c20187 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.079436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5c2d-7357-425b-a2ab-2bc192c20187 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.079719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5c2d-7357-425b-a2ab-2bc192c20187 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.079992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0ef5c2d-7357-425b-a2ab-2bc192c20187 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.080851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef5c2d-7357-425b-a2ab-2bc192c20187 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.083030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0ef5c2d-7357-425b-a2ab-2bc192c20187 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.144566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 771/1543] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/projects => generated 377 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:34.149955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.167645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0ba5776-aec7-4580-a2f1-4fb8de432f81 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.212545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6b1f6-35e6-4d39-9e74-3916683c11eb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.212888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6b1f6-35e6-4d39-9e74-3916683c11eb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.213228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69f6b1f6-35e6-4d39-9e74-3916683c11eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.243526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-69f6b1f6-35e6-4d39-9e74-3916683c11eb None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.243942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a0bc0-7206-4c08-951d-a439e77c5550 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.244489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a0bc0-7206-4c08-951d-a439e77c5550 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.244772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a0bc0-7206-4c08-951d-a439e77c5550 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.245094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-271a0bc0-7206-4c08-951d-a439e77c5550 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.245373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-69f6b1f6-35e6-4d39-9e74-3916683c11eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.248515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a0bc0-7206-4c08-951d-a439e77c5550 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.248515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-271a0bc0-7206-4c08-951d-a439e77c5550 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.264958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 772/1544] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.279252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45220-f56d-40f0-b154-3a7d59385e23 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.279641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45220-f56d-40f0-b154-3a7d59385e23 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.279777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 773/1545] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/users => generated 289 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:34.279881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1c45220-f56d-40f0-b154-3a7d59385e23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.284642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a0bc0-7206-4c08-951d-a439e77c5550 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.295244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-271a0bc0-7206-4c08-951d-a439e77c5550 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.306348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d033c5ab-ddb8-449a-8ad0-4d8a7b00c9cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.310813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f1c45220-f56d-40f0-b154-3a7d59385e23 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.312054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f1c45220-f56d-40f0-b154-3a7d59385e23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.313938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033c5ab-ddb8-449a-8ad0-4d8a7b00c9cf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.314267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033c5ab-ddb8-449a-8ad0-4d8a7b00c9cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.314469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d033c5ab-ddb8-449a-8ad0-4d8a7b00c9cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.315213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033c5ab-ddb8-449a-8ad0-4d8a7b00c9cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.316822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d033c5ab-ddb8-449a-8ad0-4d8a7b00c9cf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.334158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 774/1546] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:36:34.336400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5200-86b4-465f-a993-0309fcd5565f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.336695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5200-86b4-465f-a993-0309fcd5565f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.336974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84ae5200-86b4-465f-a993-0309fcd5565f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.341885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 773/1547] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.342934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c45220-f56d-40f0-b154-3a7d59385e23 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.358288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1c45220-f56d-40f0-b154-3a7d59385e23 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.365739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-84ae5200-86b4-465f-a993-0309fcd5565f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.367788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-84ae5200-86b4-465f-a993-0309fcd5565f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.378928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea3ce35-a5fd-4c89-871a-03961ec4e3dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.379624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3ce35-a5fd-4c89-871a-03961ec4e3dc admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.379906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3ce35-a5fd-4c89-871a-03961ec4e3dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.380179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea3ce35-a5fd-4c89-871a-03961ec4e3dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.381073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3ce35-a5fd-4c89-871a-03961ec4e3dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.383768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 775/1548] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.383922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea3ce35-a5fd-4c89-871a-03961ec4e3dc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.384743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5200-86b4-465f-a993-0309fcd5565f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.396884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 774/1549] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:34.398891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141695a-cdb5-4b80-8de2-aaaff2c5dc2a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.399191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141695a-cdb5-4b80-8de2-aaaff2c5dc2a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.399474 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2141695a-cdb5-4b80-8de2-aaaff2c5dc2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.402564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84ae5200-86b4-465f-a993-0309fcd5565f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.408603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.409272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.409998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.410280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.411017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:34.411320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.412977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.444302 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 776/1550] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:34.445235 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.447022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2141695a-cdb5-4b80-8de2-aaaff2c5dc2a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.448526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2141695a-cdb5-4b80-8de2-aaaff2c5dc2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.460457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-098e35e8-fdef-4c5b-aa9a-689fe875c92c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.471016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 775/1551] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.471849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141695a-cdb5-4b80-8de2-aaaff2c5dc2a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.472714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.473676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.474684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.474968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] PATH_INFO: `/v3/projects/da102ca6c6b5463a8ebc237d9eb8dfae/users/e037c38a998240b293910049cfe37799/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.484060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2141695a-cdb5-4b80-8de2-aaaff2c5dc2a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.501780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da102ca6c6b5463a8ebc237d9eb8dfae, user_id=e037c38a998240b293910049cfe37799, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.502855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:36:34.502855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: warnings.warn(msg) Jul 12 08:36:34.502855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: Jul 12 08:36:34.504788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.508808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3400bd12-de2d-42cf-b8ed-b9fb9b567886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.509503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400bd12-de2d-42cf-b8ed-b9fb9b567886 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.510039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400bd12-de2d-42cf-b8ed-b9fb9b567886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.510382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3400bd12-de2d-42cf-b8ed-b9fb9b567886 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.511135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400bd12-de2d-42cf-b8ed-b9fb9b567886 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.513175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3400bd12-de2d-42cf-b8ed-b9fb9b567886 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.536912 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 777/1552] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:34 2022] PUT /identity/v3/projects/da102ca6c6b5463a8ebc237d9eb8dfae/users/e037c38a998240b293910049cfe37799/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 92 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:34.538300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.560968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 776/1553] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/projects => generated 385 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:34.564613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccca09-642a-4b19-94b4-9efb06485413 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.566862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccca09-642a-4b19-94b4-9efb06485413 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.567657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ccca09-642a-4b19-94b4-9efb06485413 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.602550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-39ccca09-642a-4b19-94b4-9efb06485413 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.604133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-39ccca09-642a-4b19-94b4-9efb06485413 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.649768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-916d8422-beb8-4a4f-afd3-cc620ce20eb2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.671564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:34.682778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 777/1554] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.685270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55de34-e297-4192-8261-df22758ec44b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.685604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55de34-e297-4192-8261-df22758ec44b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.685905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c55de34-e297-4192-8261-df22758ec44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.705461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0c55de34-e297-4192-8261-df22758ec44b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.706796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0c55de34-e297-4192-8261-df22758ec44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.716084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 778/1555] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.717165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7b977-d0bc-498b-9eb0-ade700a6b2bf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.717586 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7b977-d0bc-498b-9eb0-ade700a6b2bf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.717864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3e7b977-d0bc-498b-9eb0-ade700a6b2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.730015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.730672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.730951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.731223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.731942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:34.732244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.733874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.738981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b3e7b977-d0bc-498b-9eb0-ade700a6b2bf None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.740448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b3e7b977-d0bc-498b-9eb0-ade700a6b2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.745929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 778/1556] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:34.746528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.748933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 779/1557] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.750323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8325-73cb-4cbf-879f-effab1943477 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.750681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8325-73cb-4cbf-879f-effab1943477 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.751042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aed8325-73cb-4cbf-879f-effab1943477 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.761441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5e9a48d-c739-4568-b288-43a5abe3800a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.766209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349acd64-1b10-4360-9456-a3280aea5ea7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.766874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349acd64-1b10-4360-9456-a3280aea5ea7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.767157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349acd64-1b10-4360-9456-a3280aea5ea7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.767437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349acd64-1b10-4360-9456-a3280aea5ea7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.768125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349acd64-1b10-4360-9456-a3280aea5ea7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.770116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349acd64-1b10-4360-9456-a3280aea5ea7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.771305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8aed8325-73cb-4cbf-879f-effab1943477 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.773641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8aed8325-73cb-4cbf-879f-effab1943477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.782456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 780/1558] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.786881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707db91-1e14-4d07-b41e-671b4d704cb4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.787239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707db91-1e14-4d07-b41e-671b4d704cb4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.787582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3707db91-1e14-4d07-b41e-671b4d704cb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.797066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 779/1559] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/users => generated 293 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:34.797066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306b2f-cb57-45ef-a21e-33ae78704f73 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.797066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306b2f-cb57-45ef-a21e-33ae78704f73 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.797066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae306b2f-cb57-45ef-a21e-33ae78704f73 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.805689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3707db91-1e14-4d07-b41e-671b4d704cb4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.806939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3707db91-1e14-4d07-b41e-671b4d704cb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.814864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ae306b2f-cb57-45ef-a21e-33ae78704f73 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.815874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 781/1560] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.816008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae306b2f-cb57-45ef-a21e-33ae78704f73 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.817151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7e95-2384-4eaa-9929-3d7519a5a157 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.817619 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7e95-2384-4eaa-9929-3d7519a5a157 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.817759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5e7e95-2384-4eaa-9929-3d7519a5a157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.824840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 780/1561] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.826118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c960a-db23-42ad-81b2-9e580813f696 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.826403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c960a-db23-42ad-81b2-9e580813f696 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.826684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-573c960a-db23-42ad-81b2-9e580813f696 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.838925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5b5e7e95-2384-4eaa-9929-3d7519a5a157 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.840139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b5e7e95-2384-4eaa-9929-3d7519a5a157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.845694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-573c960a-db23-42ad-81b2-9e580813f696 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.846834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-573c960a-db23-42ad-81b2-9e580813f696 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.847989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 782/1562] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.848749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7e95-2384-4eaa-9929-3d7519a5a157 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.857482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 781/1563] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.858750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c960a-db23-42ad-81b2-9e580813f696 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.859479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5e7e95-2384-4eaa-9929-3d7519a5a157 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.864663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d37adc7-7987-4d62-b8d9-75020489c4c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.865306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37adc7-7987-4d62-b8d9-75020489c4c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.865618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37adc7-7987-4d62-b8d9-75020489c4c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.865888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d37adc7-7987-4d62-b8d9-75020489c4c8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.867182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37adc7-7987-4d62-b8d9-75020489c4c8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.869166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d37adc7-7987-4d62-b8d9-75020489c4c8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:34.895382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 783/1564] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:34.896693 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877578df-a576-4e19-90f0-a477af741ddc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.896983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877578df-a576-4e19-90f0-a477af741ddc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.897322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877578df-a576-4e19-90f0-a477af741ddc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.915303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-573c960a-db23-42ad-81b2-9e580813f696 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.915892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-877578df-a576-4e19-90f0-a477af741ddc None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:34.916707 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-877578df-a576-4e19-90f0-a477af741ddc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:34.926642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:34.964241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a118b143-870a-4b9b-8397-1a464375113e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.965022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118b143-870a-4b9b-8397-1a464375113e service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.965434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118b143-870a-4b9b-8397-1a464375113e service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.965817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a118b143-870a-4b9b-8397-1a464375113e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.977143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 784/1565] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:34.978565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877578df-a576-4e19-90f0-a477af741ddc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:34.987558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-877578df-a576-4e19-90f0-a477af741ddc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:34.992888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56aeed5-aaa7-49ec-b496-63c8a7c8759b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:34.993573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aeed5-aaa7-49ec-b496-63c8a7c8759b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:34.993846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aeed5-aaa7-49ec-b496-63c8a7c8759b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:34.994118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56aeed5-aaa7-49ec-b496-63c8a7c8759b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:34.994843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aeed5-aaa7-49ec-b496-63c8a7c8759b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:34.996434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e56aeed5-aaa7-49ec-b496-63c8a7c8759b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.006186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 785/1566] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:34 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:35.008046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b9d6b-75dc-4ea5-b435-ec0a7442c873 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.008382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b9d6b-75dc-4ea5-b435-ec0a7442c873 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.008661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b89b9d6b-75dc-4ea5-b435-ec0a7442c873 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.020248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:35.026475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b89b9d6b-75dc-4ea5-b435-ec0a7442c873 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:35.027725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b89b9d6b-75dc-4ea5-b435-ec0a7442c873 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:35.032767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118b143-870a-4b9b-8397-1a464375113e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.034070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a118b143-870a-4b9b-8397-1a464375113e service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.036557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 786/1567] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:35.040439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b9d6b-75dc-4ea5-b435-ec0a7442c873 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.044053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 782/1568] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:35.045570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec73566-8edc-42e3-8be6-0ded9df6eadd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.045862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec73566-8edc-42e3-8be6-0ded9df6eadd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.046136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec73566-8edc-42e3-8be6-0ded9df6eadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.050916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b89b9d6b-75dc-4ea5-b435-ec0a7442c873 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.055778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.056429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.056706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.056977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.057731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:35.058031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.059089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:36:35.059089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 12 08:36:35.059089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: Jul 12 08:36:35.060141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.066922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0ec73566-8edc-42e3-8be6-0ded9df6eadd None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:35.068266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0ec73566-8edc-42e3-8be6-0ded9df6eadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:35.072623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 787/1569] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:35.073471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.083667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 783/1570] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:35.084542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec73566-8edc-42e3-8be6-0ded9df6eadd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.090380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c0a722-5fdb-4c71-98c3-eeeddab1366e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.095402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.096088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.096415 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.096696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.097263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec73566-8edc-42e3-8be6-0ded9df6eadd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.097463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:35.097766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.099359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.102529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fb6ce-5855-4bf5-a2f9-4cd74d57c382 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.103194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb6ce-5855-4bf5-a2f9-4cd74d57c382 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.103477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb6ce-5855-4bf5-a2f9-4cd74d57c382 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.103751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-556fb6ce-5855-4bf5-a2f9-4cd74d57c382 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.104444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fb6ce-5855-4bf5-a2f9-4cd74d57c382 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.106636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-556fb6ce-5855-4bf5-a2f9-4cd74d57c382 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.112050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 788/1571] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:35.113072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.123953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a20ed10-17d3-4bad-a3c5-e1bf104b3f72 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.128988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.129557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.129837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.130106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.130830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:35.131137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.133351 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.137538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 784/1572] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/users => generated 287 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.138808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fb6ce-5855-4bf5-a2f9-4cd74d57c382 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.156597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 789/1573] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:35.156597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.156903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-556fb6ce-5855-4bf5-a2f9-4cd74d57c382 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.157460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19478-9079-4d96-a9f4-120c59f24d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.158139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19478-9079-4d96-a9f4-120c59f24d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.158461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19478-9079-4d96-a9f4-120c59f24d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.158697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffc19478-9079-4d96-a9f4-120c59f24d41 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.159474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc19478-9079-4d96-a9f4-120c59f24d41 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.161412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffc19478-9079-4d96-a9f4-120c59f24d41 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.167624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516d5f20-cd09-4fd5-aefc-0617337ba933 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.172436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.173074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.173219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 785/1574] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:35.173378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.173672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.173942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19478-9079-4d96-a9f4-120c59f24d41 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.174504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:35.174841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.176637 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.186727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffc19478-9079-4d96-a9f4-120c59f24d41 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.191089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 790/1575] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:35.191951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.200124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.200818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.201140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.201438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.202143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.203205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:36:35.203205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: warnings.warn(msg) Jul 12 08:36:35.203205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: Jul 12 08:36:35.204090 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd3a530-84f2-48b0-9b36-338a3766b6dc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.204593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.210438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.211550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.212176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.212603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.213849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:35.214346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.216414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.229657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 791/1576] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:35.230924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.234199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 786/1577] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/projects => generated 385 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.234919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.248605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cedba3f3-1c5e-4fae-b94a-b8e7cde5d024 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.312858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af78220-81f1-4a3d-a346-ac71a8ada562 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.317453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31209b4f-3d33-42d9-8549-5d9743e10cda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.318382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209b4f-3d33-42d9-8549-5d9743e10cda admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.318624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209b4f-3d33-42d9-8549-5d9743e10cda admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.318929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31209b4f-3d33-42d9-8549-5d9743e10cda admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.320280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31209b4f-3d33-42d9-8549-5d9743e10cda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.323889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31209b4f-3d33-42d9-8549-5d9743e10cda admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.324531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650485b-6508-436b-8189-c2694548801c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.325366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650485b-6508-436b-8189-c2694548801c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.325753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650485b-6508-436b-8189-c2694548801c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.326139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8650485b-6508-436b-8189-c2694548801c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.326998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650485b-6508-436b-8189-c2694548801c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.328699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8650485b-6508-436b-8189-c2694548801c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.340572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 787/1578] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:35.341375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650485b-6508-436b-8189-c2694548801c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.353288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8650485b-6508-436b-8189-c2694548801c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.358607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 792/1579] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/projects => generated 383 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.359603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31209b4f-3d33-42d9-8549-5d9743e10cda admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.364663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b82cc1-7729-4af3-8cf9-200f3952784b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.365370 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82cc1-7729-4af3-8cf9-200f3952784b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.365783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82cc1-7729-4af3-8cf9-200f3952784b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.366588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b82cc1-7729-4af3-8cf9-200f3952784b admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.368249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b82cc1-7729-4af3-8cf9-200f3952784b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.370897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b82cc1-7729-4af3-8cf9-200f3952784b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.390912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:35.405859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 788/1580] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/projects => generated 379 bytes in 65 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.408720 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b82cc1-7729-4af3-8cf9-200f3952784b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.456422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31209b4f-3d33-42d9-8549-5d9743e10cda admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.501497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b82cc1-7729-4af3-8cf9-200f3952784b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.511138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e043-da81-4a00-8af6-3579492dfb17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.511886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e043-da81-4a00-8af6-3579492dfb17 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.512169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e043-da81-4a00-8af6-3579492dfb17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.512977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e4e043-da81-4a00-8af6-3579492dfb17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.514193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e043-da81-4a00-8af6-3579492dfb17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.516454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e4e043-da81-4a00-8af6-3579492dfb17 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.527176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342cf1d-627f-4425-8dcd-6c425698b663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.528983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342cf1d-627f-4425-8dcd-6c425698b663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.529519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342cf1d-627f-4425-8dcd-6c425698b663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.529633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b342cf1d-627f-4425-8dcd-6c425698b663 admin admin] PATH_INFO: `/v3/projects/0307b2d30e934971af7eccf01dacf308/users/4c0850371fa74891b7020e94c089db00/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.536516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:35.548953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342cf1d-627f-4425-8dcd-6c425698b663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0307b2d30e934971af7eccf01dacf308, user_id=4c0850371fa74891b7020e94c089db00, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.552018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b342cf1d-627f-4425-8dcd-6c425698b663 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.552273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 789/1581] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/projects => generated 393 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.553067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e043-da81-4a00-8af6-3579492dfb17 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.566011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 793/1582] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:35 2022] PUT /identity/v3/projects/0307b2d30e934971af7eccf01dacf308/users/4c0850371fa74891b7020e94c089db00/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:35.573840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342cf1d-627f-4425-8dcd-6c425698b663 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.628464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e4e043-da81-4a00-8af6-3579492dfb17 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.644846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b342cf1d-627f-4425-8dcd-6c425698b663 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.653926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f13251-e810-4756-afec-a74c5837cf90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.654832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f13251-e810-4756-afec-a74c5837cf90 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.655114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f13251-e810-4756-afec-a74c5837cf90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.655551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f13251-e810-4756-afec-a74c5837cf90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.656258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f13251-e810-4756-afec-a74c5837cf90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.658198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f13251-e810-4756-afec-a74c5837cf90 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.692977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 794/1583] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/projects => generated 387 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.694620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f13251-e810-4756-afec-a74c5837cf90 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.701373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a40f6-a4da-4f91-a474-07b584ef7fdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.702779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a40f6-a4da-4f91-a474-07b584ef7fdf admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.703076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a40f6-a4da-4f91-a474-07b584ef7fdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.703345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23a40f6-a4da-4f91-a474-07b584ef7fdf admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.704848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a40f6-a4da-4f91-a474-07b584ef7fdf admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.707127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23a40f6-a4da-4f91-a474-07b584ef7fdf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.734924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 790/1584] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/users => generated 293 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.739689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a40f6-a4da-4f91-a474-07b584ef7fdf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.748093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:35.757229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23a40f6-a4da-4f91-a474-07b584ef7fdf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.796230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f13251-e810-4756-afec-a74c5837cf90 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.805587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de8a3-d225-4254-ab87-d3b9c0bfaca3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.806549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de8a3-d225-4254-ab87-d3b9c0bfaca3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.806827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de8a3-d225-4254-ab87-d3b9c0bfaca3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.807103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd9de8a3-d225-4254-ab87-d3b9c0bfaca3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.808312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9de8a3-d225-4254-ab87-d3b9c0bfaca3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.810585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd9de8a3-d225-4254-ab87-d3b9c0bfaca3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.823657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 795/1585] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:35 2022] GET /identity/v3/roles => generated 1420 bytes in 130 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:35.824654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de8a3-d225-4254-ab87-d3b9c0bfaca3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.840490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd9de8a3-d225-4254-ab87-d3b9c0bfaca3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.845724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.846533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.846815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.847093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.847788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.848904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:36:35.848904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 12 08:36:35.848904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: Jul 12 08:36:35.851212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.851961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758403db-5164-4aaf-9fb7-08870c9e2882 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.852764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758403db-5164-4aaf-9fb7-08870c9e2882 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.853113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758403db-5164-4aaf-9fb7-08870c9e2882 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.857117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758403db-5164-4aaf-9fb7-08870c9e2882 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.857277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758403db-5164-4aaf-9fb7-08870c9e2882 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.859141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758403db-5164-4aaf-9fb7-08870c9e2882 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.876385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 796/1586] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/users => generated 290 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.877354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.889319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 791/1587] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.889797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce6d7ff-3c23-401e-8dfb-e0e422811457 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.890776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbb242-d7b6-4dbf-81de-cde924fb4634 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.891155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbb242-d7b6-4dbf-81de-cde924fb4634 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.891428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8fbb242-d7b6-4dbf-81de-cde924fb4634 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.898557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4112d-0efd-4a30-95b6-ba73060872b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.899628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4112d-0efd-4a30-95b6-ba73060872b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.900063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4112d-0efd-4a30-95b6-ba73060872b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.900560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be4112d-0efd-4a30-95b6-ba73060872b1 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.901484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4112d-0efd-4a30-95b6-ba73060872b1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.903803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be4112d-0efd-4a30-95b6-ba73060872b1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:35.927478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e8fbb242-d7b6-4dbf-81de-cde924fb4634 None None] MFA Rules not processed for user `4c0850371fa74891b7020e94c089db00`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:35.931031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e8fbb242-d7b6-4dbf-81de-cde924fb4634 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:35.935494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 797/1588] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/users => generated 297 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:35.936612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4112d-0efd-4a30-95b6-ba73060872b1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:35.941510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=7,keystone:SELECT=93 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:35.953869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be4112d-0efd-4a30-95b6-ba73060872b1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:35.960973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff6244-bd23-4c2f-8939-43a5800bbbb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:35.962757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff6244-bd23-4c2f-8939-43a5800bbbb8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:35.963217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff6244-bd23-4c2f-8939-43a5800bbbb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:35.963657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eff6244-bd23-4c2f-8939-43a5800bbbb8 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:35.964846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff6244-bd23-4c2f-8939-43a5800bbbb8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:35.967113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eff6244-bd23-4c2f-8939-43a5800bbbb8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.013093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 798/1589] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/users => generated 294 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:36.014919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff6244-bd23-4c2f-8939-43a5800bbbb8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.030094 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eff6244-bd23-4c2f-8939-43a5800bbbb8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.036458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0a419-40c0-4347-8dd4-9fd8c9effb40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.037144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0a419-40c0-4347-8dd4-9fd8c9effb40 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.037511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0a419-40c0-4347-8dd4-9fd8c9effb40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.037841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d0a419-40c0-4347-8dd4-9fd8c9effb40 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.039268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0a419-40c0-4347-8dd4-9fd8c9effb40 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.041088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d0a419-40c0-4347-8dd4-9fd8c9effb40 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.050777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 792/1590] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:35 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:36.059749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbb242-d7b6-4dbf-81de-cde924fb4634 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.062004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 799/1591] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.063548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0a419-40c0-4347-8dd4-9fd8c9effb40 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.081364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d0a419-40c0-4347-8dd4-9fd8c9effb40 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.084201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8fbb242-d7b6-4dbf-81de-cde924fb4634 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.088714 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3e49a-4e23-400b-86f4-b3e4b6354fab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.089590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3e49a-4e23-400b-86f4-b3e4b6354fab admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.089900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3e49a-4e23-400b-86f4-b3e4b6354fab admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.090178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb3e49a-4e23-400b-86f4-b3e4b6354fab admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.091055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3e49a-4e23-400b-86f4-b3e4b6354fab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.093242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb3e49a-4e23-400b-86f4-b3e4b6354fab admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.093717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2f949-0d3d-4fa0-8677-86fc115983e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.094741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f949-0d3d-4fa0-8677-86fc115983e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.095102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f949-0d3d-4fa0-8677-86fc115983e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.095586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd2f949-0d3d-4fa0-8677-86fc115983e9 admin admin] PATH_INFO: `/v3/projects/7e0ca864d5b34a3683866ab61ebb655f/users/4c67747bff7144b29171507dcf903ce8/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.111089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 800/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.113926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3e49a-4e23-400b-86f4-b3e4b6354fab admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.123029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2f949-0d3d-4fa0-8677-86fc115983e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e0ca864d5b34a3683866ab61ebb655f, user_id=4c67747bff7144b29171507dcf903ce8, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.126012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdd2f949-0d3d-4fa0-8677-86fc115983e9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.134087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb3e49a-4e23-400b-86f4-b3e4b6354fab admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.154393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 793/1593] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:36 2022] PUT /identity/v3/projects/7e0ca864d5b34a3683866ab61ebb655f/users/4c67747bff7144b29171507dcf903ce8/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:36.155332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2f949-0d3d-4fa0-8677-86fc115983e9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.209557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fd119-b817-44a0-b652-8e7e356412fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.211550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd119-b817-44a0-b652-8e7e356412fa admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.211753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd119-b817-44a0-b652-8e7e356412fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.212089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46fd119-b817-44a0-b652-8e7e356412fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.212894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fd119-b817-44a0-b652-8e7e356412fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.215112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46fd119-b817-44a0-b652-8e7e356412fa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.227983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 801/1594] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 116 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.229030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fd119-b817-44a0-b652-8e7e356412fa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.242336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46fd119-b817-44a0-b652-8e7e356412fa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.249155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdd2f949-0d3d-4fa0-8677-86fc115983e9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.249608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256959b-ce51-42c6-a6d1-70504acbd810 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.250629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256959b-ce51-42c6-a6d1-70504acbd810 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.250918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256959b-ce51-42c6-a6d1-70504acbd810 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.251329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7256959b-ce51-42c6-a6d1-70504acbd810 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.252299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256959b-ce51-42c6-a6d1-70504acbd810 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.254122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7256959b-ce51-42c6-a6d1-70504acbd810 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.254621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9382165-e043-45fc-b99c-9ee78116280a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.255339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382165-e043-45fc-b99c-9ee78116280a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.256185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382165-e043-45fc-b99c-9ee78116280a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.256476 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9382165-e043-45fc-b99c-9ee78116280a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.258050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9382165-e043-45fc-b99c-9ee78116280a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.260343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9382165-e043-45fc-b99c-9ee78116280a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.273524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 802/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.273524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256959b-ce51-42c6-a6d1-70504acbd810 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.273805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 794/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 118 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.278638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702133dc-6b17-4045-9c4a-cbd3c47ba30e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.279214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702133dc-6b17-4045-9c4a-cbd3c47ba30e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.279759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702133dc-6b17-4045-9c4a-cbd3c47ba30e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.281873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 795/1597] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 12 08:36:36 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:36:36.282906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702133dc-6b17-4045-9c4a-cbd3c47ba30e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.284929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7256959b-ce51-42c6-a6d1-70504acbd810 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.291848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39610bfd-6112-4220-be70-2e2aac190aa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.293407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610bfd-6112-4220-be70-2e2aac190aa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.293407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610bfd-6112-4220-be70-2e2aac190aa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.293659 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39610bfd-6112-4220-be70-2e2aac190aa4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.294697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39610bfd-6112-4220-be70-2e2aac190aa4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.296307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39610bfd-6112-4220-be70-2e2aac190aa4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.297542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702133dc-6b17-4045-9c4a-cbd3c47ba30e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.304409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193ace5-75ac-4153-8622-d5d8332c7e1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.305092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193ace5-75ac-4153-8622-d5d8332c7e1f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.305376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193ace5-75ac-4153-8622-d5d8332c7e1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.305701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0193ace5-75ac-4153-8622-d5d8332c7e1f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.306910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193ace5-75ac-4153-8622-d5d8332c7e1f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.308832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0193ace5-75ac-4153-8622-d5d8332c7e1f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.313757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 803/1598] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.315711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13665fd-0faf-418d-abe0-8fd501b5adca None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.318546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13665fd-0faf-418d-abe0-8fd501b5adca None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.319601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b13665fd-0faf-418d-abe0-8fd501b5adca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.328136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 796/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.328136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193ace5-75ac-4153-8622-d5d8332c7e1f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.341895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0193ace5-75ac-4153-8622-d5d8332c7e1f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.348521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ca89-e9b5-4fe2-9533-271b8b2a4718 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.349493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ca89-e9b5-4fe2-9533-271b8b2a4718 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.349493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ca89-e9b5-4fe2-9533-271b8b2a4718 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.349794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f14ca89-e9b5-4fe2-9533-271b8b2a4718 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.351132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14ca89-e9b5-4fe2-9533-271b8b2a4718 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.353008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f14ca89-e9b5-4fe2-9533-271b8b2a4718 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.367788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 797/1600] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.368726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ca89-e9b5-4fe2-9533-271b8b2a4718 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.375395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b13665fd-0faf-418d-abe0-8fd501b5adca None None] MFA Rules not processed for user `4c67747bff7144b29171507dcf903ce8`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:36.377343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b13665fd-0faf-418d-abe0-8fd501b5adca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:36.379909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f14ca89-e9b5-4fe2-9533-271b8b2a4718 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.386819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04bf87-fe13-47fe-8aed-045cdeef885e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.388061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04bf87-fe13-47fe-8aed-045cdeef885e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.388349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04bf87-fe13-47fe-8aed-045cdeef885e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.388644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c04bf87-fe13-47fe-8aed-045cdeef885e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.389687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04bf87-fe13-47fe-8aed-045cdeef885e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.391814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c04bf87-fe13-47fe-8aed-045cdeef885e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.402627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:INSERT=9 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:36.407373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 798/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.408221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04bf87-fe13-47fe-8aed-045cdeef885e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.430235 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c04bf87-fe13-47fe-8aed-045cdeef885e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.440022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ff7ec71-4d0a-4726-9981-d7298c7454f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.441363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ec71-4d0a-4726-9981-d7298c7454f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.441779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ec71-4d0a-4726-9981-d7298c7454f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.442260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ff7ec71-4d0a-4726-9981-d7298c7454f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.443270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7ec71-4d0a-4726-9981-d7298c7454f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.446421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ff7ec71-4d0a-4726-9981-d7298c7454f4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.464495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 799/1602] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:36 2022] GET /identity/v3/roles => generated 1420 bytes in 57 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:36.469124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e7949-0140-44ff-90a2-30470ecb0e5e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.469124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e7949-0140-44ff-90a2-30470ecb0e5e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.469367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892e7949-0140-44ff-90a2-30470ecb0e5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.483208 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 804/1603] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:36 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:36.484142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13665fd-0faf-418d-abe0-8fd501b5adca None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.498494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b13665fd-0faf-418d-abe0-8fd501b5adca None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.504567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a76f0-e1f2-40e0-87ab-7dc54042aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.505795 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a76f0-e1f2-40e0-87ab-7dc54042aefa admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.506081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a76f0-e1f2-40e0-87ab-7dc54042aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.506487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827a76f0-e1f2-40e0-87ab-7dc54042aefa admin admin] PATH_INFO: `/v3/projects/f8d0e3b397de460dbafaf3a41a3166aa/users/235888633ea44610b8149e3758721f20/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.518156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-892e7949-0140-44ff-90a2-30470ecb0e5e None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:36.520219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-892e7949-0140-44ff-90a2-30470ecb0e5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:36.529838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a76f0-e1f2-40e0-87ab-7dc54042aefa admin admin] RBAC: Authorizing `identity:create_grant(project_id=f8d0e3b397de460dbafaf3a41a3166aa, user_id=235888633ea44610b8149e3758721f20, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.533854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827a76f0-e1f2-40e0-87ab-7dc54042aefa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.554101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:36.556888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 805/1604] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:36 2022] PUT /identity/v3/projects/f8d0e3b397de460dbafaf3a41a3166aa/users/235888633ea44610b8149e3758721f20/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:36.569595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a76f0-e1f2-40e0-87ab-7dc54042aefa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.644893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 800/1605] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 12 08:36:36 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 180 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:36.645992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e7949-0140-44ff-90a2-30470ecb0e5e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.654101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827a76f0-e1f2-40e0-87ab-7dc54042aefa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.659621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892e7949-0140-44ff-90a2-30470ecb0e5e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.660534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c694398-8468-42a6-9033-fe82958f2435 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.661557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c694398-8468-42a6-9033-fe82958f2435 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.661839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c694398-8468-42a6-9033-fe82958f2435 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.662112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c694398-8468-42a6-9033-fe82958f2435 admin admin] PATH_INFO: `/v3/projects/7d7a7f079ded432fb6cc03568af9e5aa/users/536ab924a5e049bfa8ee1a723d801d7e/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.666318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb5df3-2823-4746-9422-5bae19928967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.667409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb5df3-2823-4746-9422-5bae19928967 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.667886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb5df3-2823-4746-9422-5bae19928967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.668259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0eb5df3-2823-4746-9422-5bae19928967 admin admin] PATH_INFO: `/v3/projects/7eb330d203414229afb3299a84a1adf2/users/060efd8407b3485eb67d4651006fc184/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.682011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c694398-8468-42a6-9033-fe82958f2435 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d7a7f079ded432fb6cc03568af9e5aa, user_id=536ab924a5e049bfa8ee1a723d801d7e, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.684962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c694398-8468-42a6-9033-fe82958f2435 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.689519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb5df3-2823-4746-9422-5bae19928967 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7eb330d203414229afb3299a84a1adf2, user_id=060efd8407b3485eb67d4651006fc184, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.692799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0eb5df3-2823-4746-9422-5bae19928967 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.704894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 806/1606] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:36 2022] PUT /identity/v3/projects/7d7a7f079ded432fb6cc03568af9e5aa/users/536ab924a5e049bfa8ee1a723d801d7e/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:36.711723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c694398-8468-42a6-9033-fe82958f2435 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.711851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 801/1607] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:36 2022] PUT /identity/v3/projects/7eb330d203414229afb3299a84a1adf2/users/060efd8407b3485eb67d4651006fc184/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:36.714322 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb5df3-2823-4746-9422-5bae19928967 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.800091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0eb5df3-2823-4746-9422-5bae19928967 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.800509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c694398-8468-42a6-9033-fe82958f2435 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:36.805708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830fa133-1b2b-4b64-ae26-b395d00b3798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.806499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfa787-57f3-431f-b43e-eeadb11de0a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:36.807026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa133-1b2b-4b64-ae26-b395d00b3798 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.807383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa787-57f3-431f-b43e-eeadb11de0a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.807513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa133-1b2b-4b64-ae26-b395d00b3798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.807665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa787-57f3-431f-b43e-eeadb11de0a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.807949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00dfa787-57f3-431f-b43e-eeadb11de0a6 admin admin] PATH_INFO: `/v3/projects/20b7d0ebe9f740b9be0e1c7bcba9e840/users/0a028c1d97ce4951bdbb707b772baffe/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.808083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830fa133-1b2b-4b64-ae26-b395d00b3798 admin admin] PATH_INFO: `/v3/projects/7dd85fa6fcbf4339874460bc50a0c5c5/users/1f06fc34d5b54e558aa31f5b8f4d5afa/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.824295 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfa787-57f3-431f-b43e-eeadb11de0a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20b7d0ebe9f740b9be0e1c7bcba9e840, user_id=0a028c1d97ce4951bdbb707b772baffe, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.825633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fa133-1b2b-4b64-ae26-b395d00b3798 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7dd85fa6fcbf4339874460bc50a0c5c5, user_id=1f06fc34d5b54e558aa31f5b8f4d5afa, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:36.827669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00dfa787-57f3-431f-b43e-eeadb11de0a6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.832570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830fa133-1b2b-4b64-ae26-b395d00b3798 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:36.839211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:36.847403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 807/1608] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:36 2022] PUT /identity/v3/projects/20b7d0ebe9f740b9be0e1c7bcba9e840/users/0a028c1d97ce4951bdbb707b772baffe/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:36.848393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfa787-57f3-431f-b43e-eeadb11de0a6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:36.861870 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 802/1609] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:36 2022] PUT /identity/v3/projects/7dd85fa6fcbf4339874460bc50a0c5c5/users/1f06fc34d5b54e558aa31f5b8f4d5afa/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:36.863254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6d287-f74e-4d46-b6bd-941b3c71cc5a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:36.863546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6d287-f74e-4d46-b6bd-941b3c71cc5a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:36.863822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19a6d287-f74e-4d46-b6bd-941b3c71cc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:36.937032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-19a6d287-f74e-4d46-b6bd-941b3c71cc5a None None] MFA Rules not processed for user `235888633ea44610b8149e3758721f20`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:36.937032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-19a6d287-f74e-4d46-b6bd-941b3c71cc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:36.956436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00dfa787-57f3-431f-b43e-eeadb11de0a6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.020096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 803/1610] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:36 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:37.021538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6d287-f74e-4d46-b6bd-941b3c71cc5a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.027941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:37.060735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5346d26f-cf24-4758-9f23-4806782b46ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.062096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d26f-cf24-4758-9f23-4806782b46ca admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.062527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d26f-cf24-4758-9f23-4806782b46ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.062947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5346d26f-cf24-4758-9f23-4806782b46ca admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.063787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346d26f-cf24-4758-9f23-4806782b46ca admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.066118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5346d26f-cf24-4758-9f23-4806782b46ca admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.102953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 808/1611] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:36 2022] POST /identity/v3/projects => generated 373 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:37.104527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8933d4-dca3-4a2a-b682-564265b2385b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.105045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8933d4-dca3-4a2a-b682-564265b2385b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.105892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8933d4-dca3-4a2a-b682-564265b2385b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.113894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19a6d287-f74e-4d46-b6bd-941b3c71cc5a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.126677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-eb8933d4-dca3-4a2a-b682-564265b2385b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:37.127873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-eb8933d4-dca3-4a2a-b682-564265b2385b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:37.192595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c506b5-415a-44d6-bb6b-c9b6e6df33d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.193181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c506b5-415a-44d6-bb6b-c9b6e6df33d4 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.193545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c506b5-415a-44d6-bb6b-c9b6e6df33d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.193822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c506b5-415a-44d6-bb6b-c9b6e6df33d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.206410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 809/1612] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:37.208580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842ec31-3180-42e6-acad-72377affa22e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.209022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842ec31-3180-42e6-acad-72377affa22e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.209489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a842ec31-3180-42e6-acad-72377affa22e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.236349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a842ec31-3180-42e6-acad-72377affa22e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:37.237606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a842ec31-3180-42e6-acad-72377affa22e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:37.247709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 810/1613] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:37.249019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49afe53-fd89-458b-907e-e113b15c03ec None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.249307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49afe53-fd89-458b-907e-e113b15c03ec None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.249642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49afe53-fd89-458b-907e-e113b15c03ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.267723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c506b5-415a-44d6-bb6b-c9b6e6df33d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.268222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d49afe53-fd89-458b-907e-e113b15c03ec None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:37.269340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59c506b5-415a-44d6-bb6b-c9b6e6df33d4 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.269572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d49afe53-fd89-458b-907e-e113b15c03ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:37.279710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 811/1614] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:37.280966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b376ffb-fcea-42c4-b4aa-4615409febe2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.281250 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b376ffb-fcea-42c4-b4aa-4615409febe2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.281565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b376ffb-fcea-42c4-b4aa-4615409febe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.284915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 804/1615] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:37.291731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c506b5-415a-44d6-bb6b-c9b6e6df33d4 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.302350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c506b5-415a-44d6-bb6b-c9b6e6df33d4 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.307652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.308289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.308568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.308969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.309547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.311813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.320420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5b376ffb-fcea-42c4-b4aa-4615409febe2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:37.321989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b376ffb-fcea-42c4-b4aa-4615409febe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:37.334646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 812/1616] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:37.336486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b376ffb-fcea-42c4-b4aa-4615409febe2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.353553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 805/1617] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:37 2022] POST /identity/v3/projects => generated 387 bytes in 68 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:37.354674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.356726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:37.357166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b376ffb-fcea-42c4-b4aa-4615409febe2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.372095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:37.396443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:37.446673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661cd10-2dd2-4344-b177-351e25d5f23c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.447326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661cd10-2dd2-4344-b177-351e25d5f23c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.447602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661cd10-2dd2-4344-b177-351e25d5f23c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.447871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661cd10-2dd2-4344-b177-351e25d5f23c admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.448610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661cd10-2dd2-4344-b177-351e25d5f23c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.453914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661cd10-2dd2-4344-b177-351e25d5f23c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.475261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-948ebf12-0752-4ca9-a02c-6012c27532d5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.481138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86396f2-a231-444a-9cea-baed06949d58 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.481782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86396f2-a231-444a-9cea-baed06949d58 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.482129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86396f2-a231-444a-9cea-baed06949d58 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.482404 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86396f2-a231-444a-9cea-baed06949d58 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.500422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 813/1618] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:37 2022] POST /identity/v3/users => generated 293 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:37.501241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86396f2-a231-444a-9cea-baed06949d58 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.502271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661cd10-2dd2-4344-b177-351e25d5f23c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.502743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86396f2-a231-444a-9cea-baed06949d58 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.521608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661cd10-2dd2-4344-b177-351e25d5f23c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.526837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9697cd-7199-445d-aef6-cf550820bb57 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.527783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9697cd-7199-445d-aef6-cf550820bb57 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.528067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9697cd-7199-445d-aef6-cf550820bb57 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.528647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a9697cd-7199-445d-aef6-cf550820bb57 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.535173 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 806/1619] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:37.540505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86396f2-a231-444a-9cea-baed06949d58 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.541803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9697cd-7199-445d-aef6-cf550820bb57 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.543658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a9697cd-7199-445d-aef6-cf550820bb57 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.556952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 814/1620] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:37.558421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9697cd-7199-445d-aef6-cf550820bb57 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.567837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86396f2-a231-444a-9cea-baed06949d58 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.575591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a9697cd-7199-445d-aef6-cf550820bb57 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.576590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b68b7-c72d-4ce3-af83-17159a16c33d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.580984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b68b7-c72d-4ce3-af83-17159a16c33d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.581274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b68b7-c72d-4ce3-af83-17159a16c33d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.582977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73b68b7-c72d-4ce3-af83-17159a16c33d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.584472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85495b4-b5ab-46a8-98c6-d1cd82108b75 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.586636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85495b4-b5ab-46a8-98c6-d1cd82108b75 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.586917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85495b4-b5ab-46a8-98c6-d1cd82108b75 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.587188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85495b4-b5ab-46a8-98c6-d1cd82108b75 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.599199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85495b4-b5ab-46a8-98c6-d1cd82108b75 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.600746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a85495b4-b5ab-46a8-98c6-d1cd82108b75 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.615617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 815/1621] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:37.616818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b68b7-c72d-4ce3-af83-17159a16c33d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.617480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85495b4-b5ab-46a8-98c6-d1cd82108b75 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.619055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73b68b7-c72d-4ce3-af83-17159a16c33d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.630579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a85495b4-b5ab-46a8-98c6-d1cd82108b75 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.635923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 807/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:37.636778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b68b7-c72d-4ce3-af83-17159a16c33d service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.642916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba824b1-dbfa-4d26-949b-a91223bd16ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.645373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba824b1-dbfa-4d26-949b-a91223bd16ab admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.645754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba824b1-dbfa-4d26-949b-a91223bd16ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.646035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba824b1-dbfa-4d26-949b-a91223bd16ab admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.646802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba824b1-dbfa-4d26-949b-a91223bd16ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.650753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba824b1-dbfa-4d26-949b-a91223bd16ab admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.650913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73b68b7-c72d-4ce3-af83-17159a16c33d service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.656874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc2b4fd-b174-4a2a-a748-3cbcd80901ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.657834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b4fd-b174-4a2a-a748-3cbcd80901ca admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.658237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b4fd-b174-4a2a-a748-3cbcd80901ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.658626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc2b4fd-b174-4a2a-a748-3cbcd80901ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.659486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2b4fd-b174-4a2a-a748-3cbcd80901ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.661350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc2b4fd-b174-4a2a-a748-3cbcd80901ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.680480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 808/1623] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:37.683538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fb88f-95f1-4509-acf3-de097451920c None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.683836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fb88f-95f1-4509-acf3-de097451920c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.684233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8fb88f-95f1-4509-acf3-de097451920c None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.686442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 809/1624] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 12 08:36:37 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:36:37.688277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fb88f-95f1-4509-acf3-de097451920c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.697814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 816/1625] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:37 2022] POST /identity/v3/users => generated 300 bytes in 81 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:37.699491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe305c-6986-4f10-a909-dd2fcda1e87f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.700774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe305c-6986-4f10-a909-dd2fcda1e87f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.700988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfbe305c-6986-4f10-a909-dd2fcda1e87f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.717854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8fb88f-95f1-4509-acf3-de097451920c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.726009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b442c2-1812-424b-a318-2d2de267b800 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.727309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b442c2-1812-424b-a318-2d2de267b800 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.727934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b442c2-1812-424b-a318-2d2de267b800 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.728300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b442c2-1812-424b-a318-2d2de267b800 admin admin] PATH_INFO: `/v3/projects/b364f946114147a584ec0569aa5ea8bf/users/64942d126dd542aabba75ed5edb0dff2/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.730802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dfbe305c-6986-4f10-a909-dd2fcda1e87f None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:37.732645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dfbe305c-6986-4f10-a909-dd2fcda1e87f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:37.766328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b442c2-1812-424b-a318-2d2de267b800 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364f946114147a584ec0569aa5ea8bf, user_id=64942d126dd542aabba75ed5edb0dff2, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.770959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b442c2-1812-424b-a318-2d2de267b800 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.799005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 810/1626] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:37 2022] PUT /identity/v3/projects/b364f946114147a584ec0569aa5ea8bf/users/64942d126dd542aabba75ed5edb0dff2/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:37.801044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b442c2-1812-424b-a318-2d2de267b800 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.885184 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 817/1627] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:36:37 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:37.886169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe305c-6986-4f10-a909-dd2fcda1e87f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.912543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b442c2-1812-424b-a318-2d2de267b800 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.922968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ee6ba-5566-46df-a864-20544a6c1509 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.923663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ee6ba-5566-46df-a864-20544a6c1509 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.923948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ee6ba-5566-46df-a864-20544a6c1509 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.924350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0ee6ba-5566-46df-a864-20544a6c1509 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.924939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ee6ba-5566-46df-a864-20544a6c1509 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.926875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0ee6ba-5566-46df-a864-20544a6c1509 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.933543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfbe305c-6986-4f10-a909-dd2fcda1e87f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:37.945034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881648a-06cc-49fb-ab32-438af48a9114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:37.945758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881648a-06cc-49fb-ab32-438af48a9114 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:37.946040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881648a-06cc-49fb-ab32-438af48a9114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:37.946317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d881648a-06cc-49fb-ab32-438af48a9114 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:37.946654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 811/1628] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:37.947515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ee6ba-5566-46df-a864-20544a6c1509 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:37.952459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881648a-06cc-49fb-ab32-438af48a9114 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:37.954075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d881648a-06cc-49fb-ab32-438af48a9114 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:37.979321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 818/1629] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:37.980301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881648a-06cc-49fb-ab32-438af48a9114 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:38.004727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d881648a-06cc-49fb-ab32-438af48a9114 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:38.015520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b95dc7-f51b-40fe-b280-bba03d5a567f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:38.016438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95dc7-f51b-40fe-b280-bba03d5a567f admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:38.016712 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95dc7-f51b-40fe-b280-bba03d5a567f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:38.016988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50b95dc7-f51b-40fe-b280-bba03d5a567f admin admin] PATH_INFO: `/v3/projects/f9026b998cfa47f9a00313a75fefe4e1/users/bc444a81006c4998ae397cc9daa01caa/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:38.040806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0ee6ba-5566-46df-a864-20544a6c1509 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:38.045906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dbae5-fb10-42d2-8880-a2e80a5ac0a2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:38.046990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dbae5-fb10-42d2-8880-a2e80a5ac0a2 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:38.047764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dbae5-fb10-42d2-8880-a2e80a5ac0a2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:38.048243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-635dbae5-fb10-42d2-8880-a2e80a5ac0a2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:38.055418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b95dc7-f51b-40fe-b280-bba03d5a567f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9026b998cfa47f9a00313a75fefe4e1, user_id=bc444a81006c4998ae397cc9daa01caa, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:38.058180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50b95dc7-f51b-40fe-b280-bba03d5a567f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:38.081173 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:38.087284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 819/1630] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:37 2022] PUT /identity/v3/projects/f9026b998cfa47f9a00313a75fefe4e1/users/bc444a81006c4998ae397cc9daa01caa/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:38.087940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b95dc7-f51b-40fe-b280-bba03d5a567f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:38.131739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:38.146673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635dbae5-fb10-42d2-8880-a2e80a5ac0a2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:38.149061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-635dbae5-fb10-42d2-8880-a2e80a5ac0a2 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:38.176619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 812/1631] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:38.179275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dbae5-fb10-42d2-8880-a2e80a5ac0a2 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:38.205954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-635dbae5-fb10-42d2-8880-a2e80a5ac0a2 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:38.263927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50b95dc7-f51b-40fe-b280-bba03d5a567f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:38.277201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1678207-4f58-448e-a4af-9fa81c1fab64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:38.278132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678207-4f58-448e-a4af-9fa81c1fab64 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:38.278666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678207-4f58-448e-a4af-9fa81c1fab64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:38.278940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1678207-4f58-448e-a4af-9fa81c1fab64 admin admin] PATH_INFO: `/v3/projects/b364f946114147a584ec0569aa5ea8bf/users/64942d126dd542aabba75ed5edb0dff2/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:38.280952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1678207-4f58-448e-a4af-9fa81c1fab64 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b364f946114147a584ec0569aa5ea8bf, user_id=64942d126dd542aabba75ed5edb0dff2, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:38.291387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1678207-4f58-448e-a4af-9fa81c1fab64 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:38.312256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 820/1632] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:38 2022] PUT /identity/v3/projects/b364f946114147a584ec0569aa5ea8bf/users/64942d126dd542aabba75ed5edb0dff2/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:38.322586 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e984-7797-4dbc-967e-2f5b533ce6b5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:38.324540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e984-7797-4dbc-967e-2f5b533ce6b5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:38.324540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff9e984-7797-4dbc-967e-2f5b533ce6b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:38.365167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dea4a-15f6-4fa3-ad05-340bb58145e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:38.367161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dea4a-15f6-4fa3-ad05-340bb58145e5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:38.368096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dea4a-15f6-4fa3-ad05-340bb58145e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:38.368537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83dea4a-15f6-4fa3-ad05-340bb58145e5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:38.370859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dea4a-15f6-4fa3-ad05-340bb58145e5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:38.373915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83dea4a-15f6-4fa3-ad05-340bb58145e5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:38.375976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5ff9e984-7797-4dbc-967e-2f5b533ce6b5 None None] MFA Rules not processed for user `64942d126dd542aabba75ed5edb0dff2`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:38.377567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5ff9e984-7797-4dbc-967e-2f5b533ce6b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:38.424989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 813/1633] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:38 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:38.429444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dea4a-15f6-4fa3-ad05-340bb58145e5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:38.453259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83dea4a-15f6-4fa3-ad05-340bb58145e5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:38.607752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d27764-039f-4f43-beb0-aeeba18850bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:38.609120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27764-039f-4f43-beb0-aeeba18850bf admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:38.609411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27764-039f-4f43-beb0-aeeba18850bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:38.609716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d27764-039f-4f43-beb0-aeeba18850bf admin admin] PATH_INFO: `/v3/projects/f9026b998cfa47f9a00313a75fefe4e1/users/bc444a81006c4998ae397cc9daa01caa/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:38.615771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27764-039f-4f43-beb0-aeeba18850bf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9026b998cfa47f9a00313a75fefe4e1, user_id=bc444a81006c4998ae397cc9daa01caa, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:38.622464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d27764-039f-4f43-beb0-aeeba18850bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:38.622844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 821/1634] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:38 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 301 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:36:38.637646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e984-7797-4dbc-967e-2f5b533ce6b5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:38.673003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 814/1635] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:38 2022] PUT /identity/v3/projects/f9026b998cfa47f9a00313a75fefe4e1/users/bc444a81006c4998ae397cc9daa01caa/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:36:38.678997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14e86-d94c-469c-800b-31a1cedec502 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:38.679608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14e86-d94c-469c-800b-31a1cedec502 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:38.680584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ad14e86-d94c-469c-800b-31a1cedec502 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:38.716403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3ad14e86-d94c-469c-800b-31a1cedec502 None None] MFA Rules not processed for user `bc444a81006c4998ae397cc9daa01caa`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:38.717971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3ad14e86-d94c-469c-800b-31a1cedec502 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:38.760297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:38.834133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff9e984-7797-4dbc-967e-2f5b533ce6b5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:38.860774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 815/1636] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:38 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:36:38.947173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e90f7-7418-49ba-8f24-b568197af102 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:38.947849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e90f7-7418-49ba-8f24-b568197af102 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:38.948197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e90f7-7418-49ba-8f24-b568197af102 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:38.948472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5e90f7-7418-49ba-8f24-b568197af102 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:38.953577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:39.083993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e90f7-7418-49ba-8f24-b568197af102 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:39.086095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5e90f7-7418-49ba-8f24-b568197af102 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:39.108796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 822/1637] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:38 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 472 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:36:39.218143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad14e86-d94c-469c-800b-31a1cedec502 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:39.236061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ad14e86-d94c-469c-800b-31a1cedec502 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:39.258946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a64bfbf8-0bd6-44f2-87b2-4c5ec406041c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:39.259664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bfbf8-0bd6-44f2-87b2-4c5ec406041c service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:39.259903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bfbf8-0bd6-44f2-87b2-4c5ec406041c service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:39.260183 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64bfbf8-0bd6-44f2-87b2-4c5ec406041c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:39.301039 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bfbf8-0bd6-44f2-87b2-4c5ec406041c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:39.306264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a64bfbf8-0bd6-44f2-87b2-4c5ec406041c service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:39.344436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 816/1638] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:39 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:39.408523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e90f7-7418-49ba-8f24-b568197af102 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:39.657584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5e90f7-7418-49ba-8f24-b568197af102 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:39.668385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:39.668915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:39.672867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:39.673191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] PATH_INFO: `/v3/users/235888633ea44610b8149e3758721f20` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:39.680501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=235888633ea44610b8149e3758721f20)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:39.682858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:39.830422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '235888633ea44610b8149e3758721f20'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:39.846391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '235888633ea44610b8149e3758721f20'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:39.869147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '235888633ea44610b8149e3758721f20'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:39.899116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '235888633ea44610b8149e3758721f20'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:39.901770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '235888633ea44610b8149e3758721f20'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:39.912517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 823/1639] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:36:39 2022] DELETE /identity/v3/users/235888633ea44610b8149e3758721f20 => generated 0 bytes in 504 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:39.917908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de09c-af6e-4389-8db7-602409d42564 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:39.918919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de09c-af6e-4389-8db7-602409d42564 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:39.919562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-910de09c-af6e-4389-8db7-602409d42564 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:39.980554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-910de09c-af6e-4389-8db7-602409d42564 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:39.981849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-910de09c-af6e-4389-8db7-602409d42564 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.174246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 817/1640] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:40.207421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:40.214071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.240429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afd3ba0d-0280-4297-8adc-c8c9a77bcf78 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:40.259946 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:40.261154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:40.261664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:40.262135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] PATH_INFO: `/v3/users/4c67747bff7144b29171507dcf903ce8` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:40.265858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c67747bff7144b29171507dcf903ce8)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:40.268511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:40.309452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:40.331978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fbf59-56dd-44c4-9ae5-1bcc1eb0e4e0 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:40.332606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fbf59-56dd-44c4-9ae5-1bcc1eb0e4e0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:40.332606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-125fbf59-56dd-44c4-9ae5-1bcc1eb0e4e0 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:40.335136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 818/1641] 10.222.0.20 () {54 vars in 961 bytes} [Tue Jul 12 08:36:40 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:36:40.349308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8213-34fa-448b-aae2-729ac659d3de None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:40.349694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8213-34fa-448b-aae2-729ac659d3de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:40.350041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995e8213-34fa-448b-aae2-729ac659d3de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:40.382318 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c67747bff7144b29171507dcf903ce8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:40.389943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-995e8213-34fa-448b-aae2-729ac659d3de None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:40.391088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-995e8213-34fa-448b-aae2-729ac659d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.401298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c67747bff7144b29171507dcf903ce8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:40.419841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c67747bff7144b29171507dcf903ce8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:40.471215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c67747bff7144b29171507dcf903ce8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:40.472782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51e91de5-59f9-4f95-bbe3-98a4dcee1f50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c67747bff7144b29171507dcf903ce8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:40.483520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 824/1642] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:36:40 2022] DELETE /identity/v3/users/4c67747bff7144b29171507dcf903ce8 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:40.492996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb00f-8f82-4bae-bd59-06c9554dc6f4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:40.493341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb00f-8f82-4bae-bd59-06c9554dc6f4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:40.493811 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5bb00f-8f82-4bae-bd59-06c9554dc6f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:40.543914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6e5bb00f-8f82-4bae-bd59-06c9554dc6f4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:40.545464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6e5bb00f-8f82-4bae-bd59-06c9554dc6f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.549165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 819/1643] 10.222.0.20 () {58 vars in 1058 bytes} [Tue Jul 12 08:36:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:36:40.550304 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8213-34fa-448b-aae2-729ac659d3de None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:40.555372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-995e8213-34fa-448b-aae2-729ac659d3de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.650434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:40.652472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 825/1644] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:40.658597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e1e7-b535-4aaa-946d-36f37bba3c41 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:40.658892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e1e7-b535-4aaa-946d-36f37bba3c41 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:40.659175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122e1e7-b535-4aaa-946d-36f37bba3c41 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:40.660567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 826/1645] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 12 08:36:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:36:40.670927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e49647-8938-4cd3-bde1-b7ba382a813e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:40.671322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e49647-8938-4cd3-bde1-b7ba382a813e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:40.671507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e49647-8938-4cd3-bde1-b7ba382a813e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:40.673613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995e8213-34fa-448b-aae2-729ac659d3de None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:40.737962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-19e49647-8938-4cd3-bde1-b7ba382a813e None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:40.739324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-19e49647-8938-4cd3-bde1-b7ba382a813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.798199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:40.800913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:40.801511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:40.801847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:40.806650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.841727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:40.843210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:40.881258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 820/1646] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:40.883971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:40.888078 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.917283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01374d21-0c7d-4b59-acc5-363926be4553 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:40.931728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:40.933489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:40.933927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:40.934341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:40.943931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 827/1647] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:36:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:40.957883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e49647-8938-4cd3-bde1-b7ba382a813e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:40.958771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:40.959291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-19e49647-8938-4cd3-bde1-b7ba382a813e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:40.961062 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:40.976698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 821/1648] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:41.007424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:41.057735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e49647-8938-4cd3-bde1-b7ba382a813e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:41.063553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346359ed-a913-4e65-94d2-0c38769f9fa0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:41.065936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346359ed-a913-4e65-94d2-0c38769f9fa0 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:41.066285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346359ed-a913-4e65-94d2-0c38769f9fa0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:41.066570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346359ed-a913-4e65-94d2-0c38769f9fa0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:41.092702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346359ed-a913-4e65-94d2-0c38769f9fa0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:41.094374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346359ed-a913-4e65-94d2-0c38769f9fa0 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:41.108993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 828/1649] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:36:42.201367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:42.202895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:42.229782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03050cf-e3a6-479b-bc89-fc2ad47b08f0 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:42.238813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:42.239708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:42.239988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:42.240261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] PATH_INFO: `/v3/projects/7e0ca864d5b34a3683866ab61ebb655f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:42.245781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e0ca864d5b34a3683866ab61ebb655f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:42.247941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:42.346538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e0ca864d5b34a3683866ab61ebb655f', 'request_id': 'req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.361391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e0ca864d5b34a3683866ab61ebb655f', 'request_id': 'req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.376383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e0ca864d5b34a3683866ab61ebb655f', 'request_id': 'req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.398437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] The token cache is being invalidate because project 7e0ca864d5b34a3683866ab61ebb655f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:36:42.400146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.403493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.405751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 822/1650] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:36:42 2022] DELETE /identity/v3/projects/7e0ca864d5b34a3683866ab61ebb655f => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:42.409603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346359ed-a913-4e65-94d2-0c38769f9fa0 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:42.422572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346359ed-a913-4e65-94d2-0c38769f9fa0 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:42.500307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:42.501315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:42.501628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:42.502032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] PATH_INFO: `/v3/users/64942d126dd542aabba75ed5edb0dff2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:42.503396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] RBAC: Authorizing `identity:delete_user(user_id=64942d126dd542aabba75ed5edb0dff2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:42.505953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:42.573140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '64942d126dd542aabba75ed5edb0dff2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.603513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '64942d126dd542aabba75ed5edb0dff2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.617348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '64942d126dd542aabba75ed5edb0dff2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.641443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '64942d126dd542aabba75ed5edb0dff2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.642781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '64942d126dd542aabba75ed5edb0dff2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:42.656081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 829/1651] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:36:42 2022] DELETE /identity/v3/users/64942d126dd542aabba75ed5edb0dff2 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:43.142470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:43.144595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:43.170161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2e31fd-4f7d-4b4e-8399-8130e1ddca39 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:43.342344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:43.343405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:43.343697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:43.343973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] PATH_INFO: `/v3/projects/f8d0e3b397de460dbafaf3a41a3166aa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:43.346287 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f8d0e3b397de460dbafaf3a41a3166aa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:43.348229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:43.422475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:43.501804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f8d0e3b397de460dbafaf3a41a3166aa', 'request_id': 'req-003b4dff-bd55-4861-8920-bbd0a4b13662'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.518056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f8d0e3b397de460dbafaf3a41a3166aa', 'request_id': 'req-003b4dff-bd55-4861-8920-bbd0a4b13662'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.538811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f8d0e3b397de460dbafaf3a41a3166aa', 'request_id': 'req-003b4dff-bd55-4861-8920-bbd0a4b13662'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.562300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] The token cache is being invalidate because project f8d0e3b397de460dbafaf3a41a3166aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:36:43.564686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.565395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.571540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 823/1652] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:36:43 2022] DELETE /identity/v3/projects/f8d0e3b397de460dbafaf3a41a3166aa => generated 0 bytes in 426 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:43.572652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:43.575564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:43.634581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a461c4-1666-4e0e-ac3f-77ca3d7b286a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:43.671132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:43.672267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:43.736356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:43.781727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:43.781727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:43.782008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:43.782191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] PATH_INFO: `/v3/users/bc444a81006c4998ae397cc9daa01caa` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:43.784507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc444a81006c4998ae397cc9daa01caa)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:43.789120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:43.826719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-003b4dff-bd55-4861-8920-bbd0a4b13662 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:43.841189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:43.845127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:43.845576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:43.845856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] PATH_INFO: `/v3/projects/b364f946114147a584ec0569aa5ea8bf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:43.848586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b364f946114147a584ec0569aa5ea8bf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:43.856818 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:43.885917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc444a81006c4998ae397cc9daa01caa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.895436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc444a81006c4998ae397cc9daa01caa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.906349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc444a81006c4998ae397cc9daa01caa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.926622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc444a81006c4998ae397cc9daa01caa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.927635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f483aa80-e74e-4843-9127-011834aa5883 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc444a81006c4998ae397cc9daa01caa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.940655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 830/1653] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:36:43 2022] DELETE /identity/v3/users/bc444a81006c4998ae397cc9daa01caa => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:43.970255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b364f946114147a584ec0569aa5ea8bf', 'request_id': 'req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.980232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b364f946114147a584ec0569aa5ea8bf', 'request_id': 'req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:43.992685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b364f946114147a584ec0569aa5ea8bf', 'request_id': 'req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:44.046247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] The token cache is being invalidate because project b364f946114147a584ec0569aa5ea8bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:36:44.048619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:44.051284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7abe8a84-eb06-4298-8af8-aa311ae8e2b2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:44.057916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 824/1654] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:36:43 2022] DELETE /identity/v3/projects/b364f946114147a584ec0569aa5ea8bf => generated 0 bytes in 385 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:44.059618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e8e90-69d7-4863-8e92-307bdff9b124 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:44.059929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e8e90-69d7-4863-8e92-307bdff9b124 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:44.060219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-739e8e90-69d7-4863-8e92-307bdff9b124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:44.105566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-739e8e90-69d7-4863-8e92-307bdff9b124 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:44.106809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-739e8e90-69d7-4863-8e92-307bdff9b124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:44.200393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 831/1655] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:36:44.202205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd09fca-5b6d-42c7-ab20-ab5f933a2b70 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:44.202505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd09fca-5b6d-42c7-ab20-ab5f933a2b70 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:44.202789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fd09fca-5b6d-42c7-ab20-ab5f933a2b70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:44.237321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2fd09fca-5b6d-42c7-ab20-ab5f933a2b70 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:44.241247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2fd09fca-5b6d-42c7-ab20-ab5f933a2b70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:44.276447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 825/1656] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:44.279528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e8e90-69d7-4863-8e92-307bdff9b124 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:44.289267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-739e8e90-69d7-4863-8e92-307bdff9b124 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:44.302079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:44.302765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:44.303052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:44.303890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:44.318063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:44.318391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:44.320815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:44.369836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 832/1657] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:44.373513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd09fca-5b6d-42c7-ab20-ab5f933a2b70 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:44.391778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fd09fca-5b6d-42c7-ab20-ab5f933a2b70 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:44.427500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6490-9066-40a2-b932-9b9caea79f18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:44.428205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6490-9066-40a2-b932-9b9caea79f18 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:44.428521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6490-9066-40a2-b932-9b9caea79f18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:44.428793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7e6490-9066-40a2-b932-9b9caea79f18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:44.454586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6490-9066-40a2-b932-9b9caea79f18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:44.456867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7e6490-9066-40a2-b932-9b9caea79f18 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:44.542007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:44.542575 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 826/1658] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:44 2022] POST /identity/v3/projects => generated 365 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:44.560719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43612f6f-0e2b-43de-b65c-702309632610 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:44.734652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:44.770955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8df3c-3fcd-4ed6-8b8c-7e759c65bcfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:44.771768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8df3c-3fcd-4ed6-8b8c-7e759c65bcfa admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:44.772200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8df3c-3fcd-4ed6-8b8c-7e759c65bcfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:44.772927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b8df3c-3fcd-4ed6-8b8c-7e759c65bcfa admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:44.773593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8df3c-3fcd-4ed6-8b8c-7e759c65bcfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:44.776128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9b8df3c-3fcd-4ed6-8b8c-7e759c65bcfa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:44.885788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 833/1659] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:44 2022] POST /identity/v3/users => generated 283 bytes in 344 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:36:44.890724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6490-9066-40a2-b932-9b9caea79f18 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:44.906738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:44.919148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7e6490-9066-40a2-b932-9b9caea79f18 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:44.934099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e439a-2568-4f0f-98df-ad79659928fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:44.935102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e439a-2568-4f0f-98df-ad79659928fe admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:44.935399 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e439a-2568-4f0f-98df-ad79659928fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:44.935680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3e439a-2568-4f0f-98df-ad79659928fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:44.936489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e439a-2568-4f0f-98df-ad79659928fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:44.938315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3e439a-2568-4f0f-98df-ad79659928fe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:44.962816 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 827/1660] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:44.966085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8df3c-3fcd-4ed6-8b8c-7e759c65bcfa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:44.983582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b8df3c-3fcd-4ed6-8b8c-7e759c65bcfa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:44.997079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f76e384-7987-461f-83e9-d582be2b326e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:44.999674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e384-7987-461f-83e9-d582be2b326e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:45.000210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e384-7987-461f-83e9-d582be2b326e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:45.001246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f76e384-7987-461f-83e9-d582be2b326e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:45.003532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76e384-7987-461f-83e9-d582be2b326e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:45.010137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f76e384-7987-461f-83e9-d582be2b326e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:45.065775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 834/1661] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:44 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:45.066197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e439a-2568-4f0f-98df-ad79659928fe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:45.081362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3e439a-2568-4f0f-98df-ad79659928fe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:45.094151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817a9b-4313-455c-947e-dd5526c8ceaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:45.095085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817a9b-4313-455c-947e-dd5526c8ceaa admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:45.095373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817a9b-4313-455c-947e-dd5526c8ceaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:45.095652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8817a9b-4313-455c-947e-dd5526c8ceaa admin admin] PATH_INFO: `/v3/projects/eb94a543db9a4d2b81cec0385ae48ea7/users/42c6fc6212dd4c42903626c6fc1c55c0/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:45.133930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817a9b-4313-455c-947e-dd5526c8ceaa admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb94a543db9a4d2b81cec0385ae48ea7, user_id=42c6fc6212dd4c42903626c6fc1c55c0, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:45.136721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8817a9b-4313-455c-947e-dd5526c8ceaa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:45.166696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 828/1662] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:45 2022] PUT /identity/v3/projects/eb94a543db9a4d2b81cec0385ae48ea7/users/42c6fc6212dd4c42903626c6fc1c55c0/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:45.178765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6313e-fb93-40d0-a959-2b8751143fae None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:45.179373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6313e-fb93-40d0-a959-2b8751143fae None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:45.179867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6313e-fb93-40d0-a959-2b8751143fae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:45.247153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-37e6313e-fb93-40d0-a959-2b8751143fae None None] MFA Rules not processed for user `42c6fc6212dd4c42903626c6fc1c55c0`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:45.248579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-37e6313e-fb93-40d0-a959-2b8751143fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:45.364345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 835/1663] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:45 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:45.369651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817a9b-4313-455c-947e-dd5526c8ceaa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:45.444907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6313e-fb93-40d0-a959-2b8751143fae None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:45.447113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-37e6313e-fb93-40d0-a959-2b8751143fae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:45.485639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8817a9b-4313-455c-947e-dd5526c8ceaa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:45.514352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0df1a-4efc-4c17-93c1-97d5c5d64a06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:45.515711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0df1a-4efc-4c17-93c1-97d5c5d64a06 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:45.516417 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0df1a-4efc-4c17-93c1-97d5c5d64a06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:45.517112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add0df1a-4efc-4c17-93c1-97d5c5d64a06 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:45.518713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0df1a-4efc-4c17-93c1-97d5c5d64a06 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:45.524764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add0df1a-4efc-4c17-93c1-97d5c5d64a06 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:45.603887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 829/1664] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:45 2022] POST /identity/v3/projects => generated 363 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:36:45.608994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0df1a-4efc-4c17-93c1-97d5c5d64a06 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:45.696603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e6313e-fb93-40d0-a959-2b8751143fae None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:45.782157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add0df1a-4efc-4c17-93c1-97d5c5d64a06 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:45.793826 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90162769-0d05-4e29-8797-a932003dedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:45.798182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162769-0d05-4e29-8797-a932003dedb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:45.798672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162769-0d05-4e29-8797-a932003dedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:45.799023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90162769-0d05-4e29-8797-a932003dedb6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:45.799859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90162769-0d05-4e29-8797-a932003dedb6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:45.807862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:45.810214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:45.811675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:45.814949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] PATH_INFO: `/v3/projects/f9026b998cfa47f9a00313a75fefe4e1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:45.816219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90162769-0d05-4e29-8797-a932003dedb6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:45.823467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9026b998cfa47f9a00313a75fefe4e1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:45.828242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: WARNING py.warnings [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:36:45.828242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: warnings.warn(msg) Jul 12 08:36:45.828242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: Jul 12 08:36:45.830232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:45.855817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:45.872691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 830/1665] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:45 2022] POST /identity/v3/users => generated 288 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:45.878403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90162769-0d05-4e29-8797-a932003dedb6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:45.907054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90162769-0d05-4e29-8797-a932003dedb6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:45.920795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae131bd-d4a9-4e86-93e6-7b1468d41864 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:45.921528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae131bd-d4a9-4e86-93e6-7b1468d41864 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:45.921816 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae131bd-d4a9-4e86-93e6-7b1468d41864 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:45.922089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cae131bd-d4a9-4e86-93e6-7b1468d41864 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:45.924974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae131bd-d4a9-4e86-93e6-7b1468d41864 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:45.929727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cae131bd-d4a9-4e86-93e6-7b1468d41864 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:45.951345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9026b998cfa47f9a00313a75fefe4e1', 'request_id': 'req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:45.956987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 831/1666] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:45 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:45.962718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae131bd-d4a9-4e86-93e6-7b1468d41864 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:45.979477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9026b998cfa47f9a00313a75fefe4e1', 'request_id': 'req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:45.986154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cae131bd-d4a9-4e86-93e6-7b1468d41864 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:45.994388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9026b998cfa47f9a00313a75fefe4e1', 'request_id': 'req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:46.019493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] The token cache is being invalidate because project f9026b998cfa47f9a00313a75fefe4e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:36:46.020068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:46.021197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3dc7ce52-a1f2-4fdc-a929-7d48139815bc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:46.024724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 836/1667] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:36:45 2022] DELETE /identity/v3/projects/f9026b998cfa47f9a00313a75fefe4e1 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:46.032342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152323-a550-42d7-9d2f-6887dea86ddb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:46.032914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152323-a550-42d7-9d2f-6887dea86ddb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:46.033400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b152323-a550-42d7-9d2f-6887dea86ddb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:46.060290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:46.098688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8b152323-a550-42d7-9d2f-6887dea86ddb None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:46.106920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8b152323-a550-42d7-9d2f-6887dea86ddb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:46.148286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:46.150737 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:46.151037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:46.151313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] PATH_INFO: `/v3/projects/1ef65e5c73d848a48c1cca28f3aba638/users/e64a21ae8f7b472b80872a57523eb108/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:46.184486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef65e5c73d848a48c1cca28f3aba638, user_id=e64a21ae8f7b472b80872a57523eb108, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:46.188907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:46.226215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 832/1668] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:45 2022] PUT /identity/v3/projects/1ef65e5c73d848a48c1cca28f3aba638/users/e64a21ae8f7b472b80872a57523eb108/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:46.230895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:46.238123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 837/1669] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:36:46.239529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:46.239714 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed867f-493d-49dd-9fac-66bbd818eeeb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:46.240011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed867f-493d-49dd-9fac-66bbd818eeeb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:46.240377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eed867f-493d-49dd-9fac-66bbd818eeeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:46.286200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4eed867f-493d-49dd-9fac-66bbd818eeeb None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:46.287421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4eed867f-493d-49dd-9fac-66bbd818eeeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:46.390141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a22c935-709c-468d-a74c-47044ada0e54 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:46.407441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a26261-c034-4911-9d63-fdb731987bb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:46.408194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a26261-c034-4911-9d63-fdb731987bb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:46.408480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a26261-c034-4911-9d63-fdb731987bb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:46.408759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a26261-c034-4911-9d63-fdb731987bb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:46.414436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a26261-c034-4911-9d63-fdb731987bb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:46.416019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a26261-c034-4911-9d63-fdb731987bb4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:46.452914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 833/1670] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:46 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:46.454339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a26261-c034-4911-9d63-fdb731987bb4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:46.463154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 838/1671] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:46.467144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed867f-493d-49dd-9fac-66bbd818eeeb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:46.471162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a26261-c034-4911-9d63-fdb731987bb4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:46.481319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a00eebe-d292-4f34-9bd4-429d82785165 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:46.482470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eebe-d292-4f34-9bd4-429d82785165 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:46.482753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eebe-d292-4f34-9bd4-429d82785165 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:46.483019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a00eebe-d292-4f34-9bd4-429d82785165 admin admin] PATH_INFO: `/v3/projects/1ef65e5c73d848a48c1cca28f3aba638/users/e64a21ae8f7b472b80872a57523eb108/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:46.490141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00eebe-d292-4f34-9bd4-429d82785165 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1ef65e5c73d848a48c1cca28f3aba638, user_id=e64a21ae8f7b472b80872a57523eb108, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:46.494894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a00eebe-d292-4f34-9bd4-429d82785165 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:46.495311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eed867f-493d-49dd-9fac-66bbd818eeeb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:46.518297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 834/1672] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:46 2022] PUT /identity/v3/projects/1ef65e5c73d848a48c1cca28f3aba638/users/e64a21ae8f7b472b80872a57523eb108/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:46.526496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c343-9928-49ef-86e6-225cab8f4915 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:46.526789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c343-9928-49ef-86e6-225cab8f4915 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:46.526889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:46.527070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7038c343-9928-49ef-86e6-225cab8f4915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:46.527583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:46.527870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:46.528143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:46.530218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:46.530746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:46.532429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:46.554363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 839/1673] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:46.555688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:46.586291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ccda194-8ef9-407d-8593-1052589a182a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:46.589851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7038c343-9928-49ef-86e6-225cab8f4915 None None] MFA Rules not processed for user `e64a21ae8f7b472b80872a57523eb108`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:46.591044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7038c343-9928-49ef-86e6-225cab8f4915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:46.654235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:46.782935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 835/1674] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:46 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:46.792168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8197-d896-4a16-a5d8-b6a30442de56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:46.794280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c343-9928-49ef-86e6-225cab8f4915 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:46.795308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8197-d896-4a16-a5d8-b6a30442de56 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:46.795757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7038c343-9928-49ef-86e6-225cab8f4915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:46.796190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8197-d896-4a16-a5d8-b6a30442de56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:46.797455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-648c8197-d896-4a16-a5d8-b6a30442de56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:46.798674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c8197-d896-4a16-a5d8-b6a30442de56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:46.802192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-648c8197-d896-4a16-a5d8-b6a30442de56 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:46.884559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 840/1675] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:46 2022] POST /identity/v3/projects => generated 367 bytes in 329 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:46.886346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8197-d896-4a16-a5d8-b6a30442de56 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:46.900767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:47.001480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7038c343-9928-49ef-86e6-225cab8f4915 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:47.076430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-648c8197-d896-4a16-a5d8-b6a30442de56 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:47.099271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb60bb-bf78-48e0-a59b-69058d31f497 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:47.102366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb60bb-bf78-48e0-a59b-69058d31f497 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:47.104020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb60bb-bf78-48e0-a59b-69058d31f497 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:47.104924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8eb60bb-bf78-48e0-a59b-69058d31f497 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:47.114692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb60bb-bf78-48e0-a59b-69058d31f497 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:47.119740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8eb60bb-bf78-48e0-a59b-69058d31f497 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:47.135891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bbcabb8-3185-4f7e-9b28-0446d7dd162b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:47.136561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcabb8-3185-4f7e-9b28-0446d7dd162b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:47.136841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcabb8-3185-4f7e-9b28-0446d7dd162b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:47.137119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bbcabb8-3185-4f7e-9b28-0446d7dd162b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:47.171729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 841/1676] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:46 2022] POST /identity/v3/users => generated 284 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:47.176052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb60bb-bf78-48e0-a59b-69058d31f497 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:47.202283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8eb60bb-bf78-48e0-a59b-69058d31f497 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:47.215380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea2e3-158b-40f1-a5c9-56c418d790c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:47.216183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea2e3-158b-40f1-a5c9-56c418d790c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:47.216351 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea2e3-158b-40f1-a5c9-56c418d790c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:47.216629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-525ea2e3-158b-40f1-a5c9-56c418d790c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:47.219585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea2e3-158b-40f1-a5c9-56c418d790c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:47.221687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-525ea2e3-158b-40f1-a5c9-56c418d790c7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:47.246261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 842/1677] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 70 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:47.250058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea2e3-158b-40f1-a5c9-56c418d790c7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:47.273604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-525ea2e3-158b-40f1-a5c9-56c418d790c7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:47.282023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd14a23-f0ec-4ec9-bea2-c7a27649f494 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:47.282828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd14a23-f0ec-4ec9-bea2-c7a27649f494 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:47.283272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd14a23-f0ec-4ec9-bea2-c7a27649f494 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:47.283761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd14a23-f0ec-4ec9-bea2-c7a27649f494 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:47.284654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd14a23-f0ec-4ec9-bea2-c7a27649f494 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:47.286625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd14a23-f0ec-4ec9-bea2-c7a27649f494 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:47.305467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 843/1678] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:47 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:47.309047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd14a23-f0ec-4ec9-bea2-c7a27649f494 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:47.334966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd14a23-f0ec-4ec9-bea2-c7a27649f494 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:47.348934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ada3f-b7c0-47a0-ba69-caccc0305668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:47.354376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ada3f-b7c0-47a0-ba69-caccc0305668 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:47.355595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ada3f-b7c0-47a0-ba69-caccc0305668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:47.355968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a4ada3f-b7c0-47a0-ba69-caccc0305668 admin admin] PATH_INFO: `/v3/projects/a4b0ea7bcd0e4d66a6b2f964f4c6d068/users/f1a6b091c0074cd7a6487b09a0cf6b1b/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:47.379611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcabb8-3185-4f7e-9b28-0446d7dd162b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:47.390236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bbcabb8-3185-4f7e-9b28-0446d7dd162b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:47.400913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ada3f-b7c0-47a0-ba69-caccc0305668 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4b0ea7bcd0e4d66a6b2f964f4c6d068, user_id=f1a6b091c0074cd7a6487b09a0cf6b1b, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:47.404255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a4ada3f-b7c0-47a0-ba69-caccc0305668 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:47.421167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 836/1679] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:46 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:36:47.429754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 844/1680] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:47 2022] PUT /identity/v3/projects/a4b0ea7bcd0e4d66a6b2f964f4c6d068/users/f1a6b091c0074cd7a6487b09a0cf6b1b/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:36:47.452641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f71ce-4d0d-4c9b-b49c-80f26429c58f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:47.454032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f71ce-4d0d-4c9b-b49c-80f26429c58f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:47.456511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5f71ce-4d0d-4c9b-b49c-80f26429c58f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:47.532021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ed5f71ce-4d0d-4c9b-b49c-80f26429c58f None None] MFA Rules not processed for user `f1a6b091c0074cd7a6487b09a0cf6b1b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:47.534378 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ed5f71ce-4d0d-4c9b-b49c-80f26429c58f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:47.599288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ada3f-b7c0-47a0-ba69-caccc0305668 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:47.689587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 837/1681] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:47 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:47.693160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f71ce-4d0d-4c9b-b49c-80f26429c58f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:47.750546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:47.755244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a4ada3f-b7c0-47a0-ba69-caccc0305668 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:47.769568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:47.770438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:47.775052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:47.777083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:47.786151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:47.801512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:47.856361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5f71ce-4d0d-4c9b-b49c-80f26429c58f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:47.880145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bff96-e5d8-4614-bdc0-56cca3d1c990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:47.880830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bff96-e5d8-4614-bdc0-56cca3d1c990 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:47.881111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bff96-e5d8-4614-bdc0-56cca3d1c990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:47.881602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871bff96-e5d8-4614-bdc0-56cca3d1c990 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:47.882745 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bff96-e5d8-4614-bdc0-56cca3d1c990 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:47.884863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-871bff96-e5d8-4614-bdc0-56cca3d1c990 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:47.937823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 838/1682] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:47 2022] POST /identity/v3/projects => generated 365 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:47.938896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:47.941600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bff96-e5d8-4614-bdc0-56cca3d1c990 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:47.948013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:47.982537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 845/1683] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:47 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:36:48.132074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871bff96-e5d8-4614-bdc0-56cca3d1c990 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:48.159983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56fec6fb-4095-4e4d-9f3e-4dc4f4c69da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:48.159983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fec6fb-4095-4e4d-9f3e-4dc4f4c69da7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:48.159983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fec6fb-4095-4e4d-9f3e-4dc4f4c69da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:48.160379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56fec6fb-4095-4e4d-9f3e-4dc4f4c69da7 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:48.161287 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fec6fb-4095-4e4d-9f3e-4dc4f4c69da7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:48.164286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56fec6fb-4095-4e4d-9f3e-4dc4f4c69da7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:48.243676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 839/1684] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:47 2022] POST /identity/v3/users => generated 289 bytes in 301 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:48.245294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:48.266489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deb1bf96-f9e5-4ee9-91c8-4eb05e264c0b service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:48.308597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b662d-4efa-4ee0-bbcd-f90270b83da0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:48.309465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b662d-4efa-4ee0-bbcd-f90270b83da0 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:48.310658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b662d-4efa-4ee0-bbcd-f90270b83da0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:48.311010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1b662d-4efa-4ee0-bbcd-f90270b83da0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:48.313110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b662d-4efa-4ee0-bbcd-f90270b83da0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:48.321343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1b662d-4efa-4ee0-bbcd-f90270b83da0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:48.373680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e000cd-4724-469c-9094-d804764f4b69 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:48.373680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e000cd-4724-469c-9094-d804764f4b69 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:48.373680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e000cd-4724-469c-9094-d804764f4b69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:48.388505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 846/1685] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:48.392807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b662d-4efa-4ee0-bbcd-f90270b83da0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:48.426190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1b662d-4efa-4ee0-bbcd-f90270b83da0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:48.451018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-75e000cd-4724-469c-9094-d804764f4b69 None None] MFA Rules not processed for user `0a028c1d97ce4951bdbb707b772baffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:48.452262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-75e000cd-4724-469c-9094-d804764f4b69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:48.463304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:48.465394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:48.466018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:48.466371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] PATH_INFO: `/v3/projects/ee45d7b779314b35b58c384e67c05b0c/users/e19afbfaed694f1ba3daecdb23bede6f/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:48.509160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee45d7b779314b35b58c384e67c05b0c, user_id=e19afbfaed694f1ba3daecdb23bede6f, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:48.519402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:48.601478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 847/1686] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:48 2022] PUT /identity/v3/projects/ee45d7b779314b35b58c384e67c05b0c/users/e19afbfaed694f1ba3daecdb23bede6f/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:48.609350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:48.616234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:48.674697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 840/1687] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 306 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:36:48.675694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e000cd-4724-469c-9094-d804764f4b69 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:48.703855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75e000cd-4724-469c-9094-d804764f4b69 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:48.759376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:48.790064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eaa65bb-9caf-4a53-9815-c9bbd9e75751 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:48.796392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:48.797532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:48.797921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:48.798656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] PATH_INFO: `/v3/users/4c0850371fa74891b7020e94c089db00` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:48.800312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] RBAC: Authorizing `identity:delete_user(user_id=4c0850371fa74891b7020e94c089db00)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:48.804892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:48.839718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:48.840406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:48.840689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:48.840966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:48.841729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:48.843393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:48.872333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 841/1688] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:48 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:48.872333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:48.874950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:48.901897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4c0850371fa74891b7020e94c089db00'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:48.920573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4c0850371fa74891b7020e94c089db00'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:48.950423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4c0850371fa74891b7020e94c089db00'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:48.970906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:INSERT=2,keystone:DELETE=9 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:48.981382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4c0850371fa74891b7020e94c089db00'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:48.983969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4c0850371fa74891b7020e94c089db00'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:48.998979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 848/1689] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:36:48 2022] DELETE /identity/v3/users/4c0850371fa74891b7020e94c089db00 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:49.000191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:49.001773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:49.041445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-303a3041-449e-4614-8619-0c548f710097 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:49.104679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10b9b6a-9da2-4f50-baf7-15e5887120ac admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:49.112690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ecb867-394a-46e2-86ae-70f2f63c555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:49.113744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecb867-394a-46e2-86ae-70f2f63c555b admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:49.114007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecb867-394a-46e2-86ae-70f2f63c555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:49.114282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ecb867-394a-46e2-86ae-70f2f63c555b admin admin] PATH_INFO: `/v3/projects/ee45d7b779314b35b58c384e67c05b0c/users/e19afbfaed694f1ba3daecdb23bede6f/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:49.117918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecb867-394a-46e2-86ae-70f2f63c555b admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee45d7b779314b35b58c384e67c05b0c, user_id=e19afbfaed694f1ba3daecdb23bede6f, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:49.121277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ecb867-394a-46e2-86ae-70f2f63c555b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:49.159945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 849/1690] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:48 2022] PUT /identity/v3/projects/ee45d7b779314b35b58c384e67c05b0c/users/e19afbfaed694f1ba3daecdb23bede6f/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:49.163848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b81f6-0588-4c54-bbed-c83af6c82ac4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:49.164501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b81f6-0588-4c54-bbed-c83af6c82ac4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:49.164796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384b81f6-0588-4c54-bbed-c83af6c82ac4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:49.192825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-384b81f6-0588-4c54-bbed-c83af6c82ac4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:49.195069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-384b81f6-0588-4c54-bbed-c83af6c82ac4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:49.202416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:49.203094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:49.203383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:49.203677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:49.205787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:49.323934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 850/1691] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:49.325535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5655-b2a6-4631-b65d-3ffc80d9275f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:49.325923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5655-b2a6-4631-b65d-3ffc80d9275f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:49.326297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5b5655-b2a6-4631-b65d-3ffc80d9275f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:49.357500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:49.362860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:49.367063 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:49.394680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6c5b5655-b2a6-4631-b65d-3ffc80d9275f None None] MFA Rules not processed for user `e19afbfaed694f1ba3daecdb23bede6f`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:49.396144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6c5b5655-b2a6-4631-b65d-3ffc80d9275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:49.400069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 842/1692] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:48 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 530 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:49.404205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:49.408191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:49.511612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc5f173-68e5-48d8-898a-3f251865f9d7 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:49.580450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:49.581801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:49.582203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:49.582578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:49.601306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:49.602917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:49.627548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 851/1693] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:49 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:49.636180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 843/1694] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:49.639382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b5655-b2a6-4631-b65d-3ffc80d9275f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:49.641403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6c5b5655-b2a6-4631-b65d-3ffc80d9275f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:49.676505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:49.773365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5b5655-b2a6-4631-b65d-3ffc80d9275f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:49.784654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09934024-f596-4a71-84c6-664c05598b90 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:49.786410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09934024-f596-4a71-84c6-664c05598b90 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:49.789879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09934024-f596-4a71-84c6-664c05598b90 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:49.790426 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09934024-f596-4a71-84c6-664c05598b90 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:49.820900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09934024-f596-4a71-84c6-664c05598b90 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:49.826800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09934024-f596-4a71-84c6-664c05598b90 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:49.863045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 852/1695] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:49 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:50.032307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:50.033870 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:50.056597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50200f48-efbd-4624-bb80-648e9a2725e6 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:50.062072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:50.062811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:50.063167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:50.063516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:50.070627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:50.156524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c140a2-e713-43f0-8829-f26f5f16ef75 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:50.157080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c140a2-e713-43f0-8829-f26f5f16ef75 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:50.157759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c140a2-e713-43f0-8829-f26f5f16ef75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:50.267528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-09c140a2-e713-43f0-8829-f26f5f16ef75 None None] MFA Rules not processed for user `e037c38a998240b293910049cfe37799`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:50.268786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-09c140a2-e713-43f0-8829-f26f5f16ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:50.275606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:50.277571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:50.294413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 844/1696] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:50 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:50.562669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 853/1697] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:50 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 402 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:36:50.568201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:50.570817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:50.738206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:50.802835 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd2f4f2-f501-4ce8-b698-45ec8929c60c service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:50.822286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cbdd8b-e9d8-4ff7-84ed-2a029f992c0b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:50.823108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbdd8b-e9d8-4ff7-84ed-2a029f992c0b service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:50.823494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbdd8b-e9d8-4ff7-84ed-2a029f992c0b service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:50.824544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cbdd8b-e9d8-4ff7-84ed-2a029f992c0b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:50.839690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c140a2-e713-43f0-8829-f26f5f16ef75 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:50.841926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-09c140a2-e713-43f0-8829-f26f5f16ef75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:50.843752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbdd8b-e9d8-4ff7-84ed-2a029f992c0b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:50.845690 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cbdd8b-e9d8-4ff7-84ed-2a029f992c0b service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:50.877309 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c140a2-e713-43f0-8829-f26f5f16ef75 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:50.877939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 845/1698] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:50 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 310 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:50.904313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:50.905207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:50.906079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:50.906243 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] PATH_INFO: `/v3/projects/0307b2d30e934971af7eccf01dacf308` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:50.912529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0307b2d30e934971af7eccf01dacf308)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:50.918078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:51.042645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0307b2d30e934971af7eccf01dacf308', 'request_id': 'req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:51.054565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0307b2d30e934971af7eccf01dacf308', 'request_id': 'req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:51.071673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0307b2d30e934971af7eccf01dacf308', 'request_id': 'req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:51.095452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] The token cache is being invalidate because project 0307b2d30e934971af7eccf01dacf308 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:36:51.095803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:51.096500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-eed49ab5-78c4-41d6-a0da-1cf6d14de1f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:51.098440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 854/1699] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:36:50 2022] DELETE /identity/v3/projects/0307b2d30e934971af7eccf01dacf308 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:51.103619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e18bd-ff8a-4d32-8b44-da697cfe8b9c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:51.104192 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e18bd-ff8a-4d32-8b44-da697cfe8b9c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:51.104385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b87e18bd-ff8a-4d32-8b44-da697cfe8b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:51.133076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b87e18bd-ff8a-4d32-8b44-da697cfe8b9c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:51.137911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b87e18bd-ff8a-4d32-8b44-da697cfe8b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:51.264938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 846/1700] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:51.276110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172734-1e65-47f8-b210-52f146c0fe18 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:51.276665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172734-1e65-47f8-b210-52f146c0fe18 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:51.276916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52172734-1e65-47f8-b210-52f146c0fe18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:51.307403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-52172734-1e65-47f8-b210-52f146c0fe18 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:51.310469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-52172734-1e65-47f8-b210-52f146c0fe18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:51.323885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 855/1701] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:51.329711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e18bd-ff8a-4d32-8b44-da697cfe8b9c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:51.346897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b87e18bd-ff8a-4d32-8b44-da697cfe8b9c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:51.362353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:51.364147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:51.364832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:51.365050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:51.366177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:36:51.367367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:51.370777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:51.395249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 847/1702] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:36:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:36:51.395402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172734-1e65-47f8-b210-52f146c0fe18 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:51.407633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52172734-1e65-47f8-b210-52f146c0fe18 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:51.421473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de0d14-2a32-4605-b135-332a81ca5c3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:51.422163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0d14-2a32-4605-b135-332a81ca5c3f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:51.422451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0d14-2a32-4605-b135-332a81ca5c3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:51.422724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46de0d14-2a32-4605-b135-332a81ca5c3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:51.423428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de0d14-2a32-4605-b135-332a81ca5c3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:51.425371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46de0d14-2a32-4605-b135-332a81ca5c3f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:51.478694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:51.501845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 856/1703] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:51 2022] POST /identity/v3/projects => generated 365 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:51.503152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:51.523622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29cecc8-b52e-4e5c-ac38-a35ac3b03202 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:51.666495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded4e3b-659c-45e6-8dad-0956152c3129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:51.667299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded4e3b-659c-45e6-8dad-0956152c3129 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:51.667588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded4e3b-659c-45e6-8dad-0956152c3129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:51.667864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ded4e3b-659c-45e6-8dad-0956152c3129 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:51.669072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded4e3b-659c-45e6-8dad-0956152c3129 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:51.670680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ded4e3b-659c-45e6-8dad-0956152c3129 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:51.719711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 848/1704] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:51 2022] POST /identity/v3/users => generated 283 bytes in 217 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:51.723896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de0d14-2a32-4605-b135-332a81ca5c3f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:51.747731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46de0d14-2a32-4605-b135-332a81ca5c3f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:51.769570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f221d-4a58-425c-9408-a6d586ba573a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:51.770288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f221d-4a58-425c-9408-a6d586ba573a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:51.770615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f221d-4a58-425c-9408-a6d586ba573a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:51.770956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470f221d-4a58-425c-9408-a6d586ba573a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:51.772347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f221d-4a58-425c-9408-a6d586ba573a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:51.782242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470f221d-4a58-425c-9408-a6d586ba573a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:51.827765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 857/1705] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:51.832604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded4e3b-659c-45e6-8dad-0956152c3129 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:51.849035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ded4e3b-659c-45e6-8dad-0956152c3129 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:51.858917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3b6e23-030d-43f7-8818-bce9da68561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:51.861697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6e23-030d-43f7-8818-bce9da68561f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:51.861913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6e23-030d-43f7-8818-bce9da68561f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:51.862454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3b6e23-030d-43f7-8818-bce9da68561f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:51.865589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b6e23-030d-43f7-8818-bce9da68561f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:51.867446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3b6e23-030d-43f7-8818-bce9da68561f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:51.910259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 849/1706] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:51 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:51.911432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f221d-4a58-425c-9408-a6d586ba573a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:51.925579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470f221d-4a58-425c-9408-a6d586ba573a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:51.938138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f296e-dcaf-42c8-a847-e46e21ddf3b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:51.942746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f296e-dcaf-42c8-a847-e46e21ddf3b9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:51.942746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f296e-dcaf-42c8-a847-e46e21ddf3b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:51.942746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c60f296e-dcaf-42c8-a847-e46e21ddf3b9 admin admin] PATH_INFO: `/v3/projects/b1ce3543c9f54f0381fc737e0a419aee/users/85aea04f956341d489fbab27b5612724/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:51.994432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f296e-dcaf-42c8-a847-e46e21ddf3b9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b1ce3543c9f54f0381fc737e0a419aee, user_id=85aea04f956341d489fbab27b5612724, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:51.999547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c60f296e-dcaf-42c8-a847-e46e21ddf3b9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:52.050331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 858/1707] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:51 2022] PUT /identity/v3/projects/b1ce3543c9f54f0381fc737e0a419aee/users/85aea04f956341d489fbab27b5612724/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:52.062384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d542-3ec7-4ff7-ab03-89e99e9161d8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:52.062685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d542-3ec7-4ff7-ab03-89e99e9161d8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:52.062970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7309d542-3ec7-4ff7-ab03-89e99e9161d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:52.157483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7309d542-3ec7-4ff7-ab03-89e99e9161d8 None None] MFA Rules not processed for user `85aea04f956341d489fbab27b5612724`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:52.166545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7309d542-3ec7-4ff7-ab03-89e99e9161d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:52.266328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:52.339874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 850/1708] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:52 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:52.344163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f296e-dcaf-42c8-a847-e46e21ddf3b9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:52.500478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d542-3ec7-4ff7-ab03-89e99e9161d8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:52.501980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7309d542-3ec7-4ff7-ab03-89e99e9161d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:52.527638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c60f296e-dcaf-42c8-a847-e46e21ddf3b9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:52.547507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17658-a201-40ec-a24d-cfbd65079b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:52.548205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17658-a201-40ec-a24d-cfbd65079b50 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:52.548488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17658-a201-40ec-a24d-cfbd65079b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:52.548764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97c17658-a201-40ec-a24d-cfbd65079b50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:52.549512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c17658-a201-40ec-a24d-cfbd65079b50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:52.554903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97c17658-a201-40ec-a24d-cfbd65079b50 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:52.627390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 859/1709] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:36:52 2022] POST /identity/v3/projects => generated 365 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:52.628834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17658-a201-40ec-a24d-cfbd65079b50 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:52.733107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7309d542-3ec7-4ff7-ab03-89e99e9161d8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:52.883387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97c17658-a201-40ec-a24d-cfbd65079b50 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:52.915444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf839f-c0e0-4d12-be87-aab6c1550409 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:52.916260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf839f-c0e0-4d12-be87-aab6c1550409 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:52.916646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf839f-c0e0-4d12-be87-aab6c1550409 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:52.917021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bebf839f-c0e0-4d12-be87-aab6c1550409 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:52.918175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf839f-c0e0-4d12-be87-aab6c1550409 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:52.926727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bebf839f-c0e0-4d12-be87-aab6c1550409 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:52.972947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:52.975509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:52.976186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:52.976186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] PATH_INFO: `/v3/users/42c6fc6212dd4c42903626c6fc1c55c0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:52.978440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] RBAC: Authorizing `identity:delete_user(user_id=42c6fc6212dd4c42903626c6fc1c55c0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:52.982572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: WARNING py.warnings [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 12 08:36:52.982572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: warnings.warn(msg) Jul 12 08:36:52.982572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: Jul 12 08:36:52.984215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:53.014371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 860/1710] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:36:52 2022] POST /identity/v3/users => generated 289 bytes in 385 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:36:53.018441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf839f-c0e0-4d12-be87-aab6c1550409 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:53.067095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bebf839f-c0e0-4d12-be87-aab6c1550409 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:53.103528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baf8c7-4686-4b2f-b0f8-15582d243c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:53.104570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baf8c7-4686-4b2f-b0f8-15582d243c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:53.104928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baf8c7-4686-4b2f-b0f8-15582d243c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:53.105522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4baf8c7-4686-4b2f-b0f8-15582d243c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:53.106361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4baf8c7-4686-4b2f-b0f8-15582d243c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:53.112172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4baf8c7-4686-4b2f-b0f8-15582d243c3d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:53.145811 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 861/1711] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 128 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:53.150739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baf8c7-4686-4b2f-b0f8-15582d243c3d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:53.190435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4baf8c7-4686-4b2f-b0f8-15582d243c3d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:53.209934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5187d-01fc-487c-b2d2-c7730aaedcc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:53.211706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5187d-01fc-487c-b2d2-c7730aaedcc5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:53.211967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5187d-01fc-487c-b2d2-c7730aaedcc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:53.212363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bc5187d-01fc-487c-b2d2-c7730aaedcc5 admin admin] PATH_INFO: `/v3/projects/b7d14e8c4d96413f83ffa4398923127c/users/1848ce412e334ba9920646cff5ead9b8/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:53.244900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '42c6fc6212dd4c42903626c6fc1c55c0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:53.297354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5187d-01fc-487c-b2d2-c7730aaedcc5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d14e8c4d96413f83ffa4398923127c, user_id=1848ce412e334ba9920646cff5ead9b8, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:53.301225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bc5187d-01fc-487c-b2d2-c7730aaedcc5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:53.331889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '42c6fc6212dd4c42903626c6fc1c55c0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:53.348750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '42c6fc6212dd4c42903626c6fc1c55c0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:53.350017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 862/1712] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:53 2022] PUT /identity/v3/projects/b7d14e8c4d96413f83ffa4398923127c/users/1848ce412e334ba9920646cff5ead9b8/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:53.353797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5187d-01fc-487c-b2d2-c7730aaedcc5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:53.372909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '42c6fc6212dd4c42903626c6fc1c55c0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:53.373797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:53.374310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-584c6b7b-9ca8-430c-95c7-87f3ee2c3849 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '42c6fc6212dd4c42903626c6fc1c55c0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:53.379031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:53.393951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 851/1713] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:36:52 2022] DELETE /identity/v3/users/42c6fc6212dd4c42903626c6fc1c55c0 => generated 0 bytes in 894 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:53.399453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec36a0-5ab4-4aef-8ed5-c95b70fddebe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:53.400665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec36a0-5ab4-4aef-8ed5-c95b70fddebe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:53.401182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76ec36a0-5ab4-4aef-8ed5-c95b70fddebe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:53.471568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-76ec36a0-5ab4-4aef-8ed5-c95b70fddebe None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:53.476915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76ec36a0-5ab4-4aef-8ed5-c95b70fddebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:53.637790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bc5187d-01fc-487c-b2d2-c7730aaedcc5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:53.667028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 852/1714] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:53.736511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec36a0-5ab4-4aef-8ed5-c95b70fddebe None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:53.738092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-76ec36a0-5ab4-4aef-8ed5-c95b70fddebe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:53.797160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:53.798453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:53.798453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:53.798637 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:53.799218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:53.800859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:53.828924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 863/1715] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:36:53 2022] GET /identity/v3/roles => generated 1420 bytes in 475 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:36:53.835553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:53.839400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:53.875968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85fc5e67-70f9-492a-8506-025722f1a95e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:53.885623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa6b5fcb-a972-4fc3-b90a-9921682bedb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:53.886537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5fcb-a972-4fc3-b90a-9921682bedb6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:53.888330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5fcb-a972-4fc3-b90a-9921682bedb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:53.890823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6b5fcb-a972-4fc3-b90a-9921682bedb6 admin admin] PATH_INFO: `/v3/projects/b7d14e8c4d96413f83ffa4398923127c/users/1848ce412e334ba9920646cff5ead9b8/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:53.902118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b5fcb-a972-4fc3-b90a-9921682bedb6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b7d14e8c4d96413f83ffa4398923127c, user_id=1848ce412e334ba9920646cff5ead9b8, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:53.908036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76ec36a0-5ab4-4aef-8ed5-c95b70fddebe None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:53.908881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa6b5fcb-a972-4fc3-b90a-9921682bedb6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:53.915812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:53.916290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:53.916567 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:53.916839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:53.948360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 864/1716] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:36:53 2022] PUT /identity/v3/projects/b7d14e8c4d96413f83ffa4398923127c/users/1848ce412e334ba9920646cff5ead9b8/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:53.950052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91b2d-6c4f-4aa2-aace-2e30a41d7692 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:53.950339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91b2d-6c4f-4aa2-aace-2e30a41d7692 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:53.950616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91b2d-6c4f-4aa2-aace-2e30a41d7692 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:53.956188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:53.960226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:53.987026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 853/1717] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 251 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:36:54.022563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c8b91b2d-6c4f-4aa2-aace-2e30a41d7692 None None] MFA Rules not processed for user `1848ce412e334ba9920646cff5ead9b8`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:54.023801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c8b91b2d-6c4f-4aa2-aace-2e30a41d7692 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:54.218216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 865/1718] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:53 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 269 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:54.232410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:54.235138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:54.329920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17fa0972-eb66-43ae-a7e4-35eada720196 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:54.406594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:54.407568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:54.408170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:54.408623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:54.446961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:54.448547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:54.462037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 854/1719] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:54 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 230 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:54.678734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91b2d-6c4f-4aa2-aace-2e30a41d7692 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:54.694662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91b2d-6c4f-4aa2-aace-2e30a41d7692 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:54.704787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6418378e-d77b-4b4a-9cae-db44c1736924 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:54.706226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418378e-d77b-4b4a-9cae-db44c1736924 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:54.708232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418378e-d77b-4b4a-9cae-db44c1736924 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:54.708561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6418378e-d77b-4b4a-9cae-db44c1736924 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:54.716400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6418378e-d77b-4b4a-9cae-db44c1736924 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:54.760679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:54.878986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418378e-d77b-4b4a-9cae-db44c1736924 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:54.882776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6418378e-d77b-4b4a-9cae-db44c1736924 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:54.919259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 866/1720] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:54 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:56.500475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:56.503139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:56.510341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:56.637853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c36b-326c-4931-9718-aac0ae8ee416 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:56.638349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c36b-326c-4931-9718-aac0ae8ee416 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:56.638430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c98c36b-326c-4931-9718-aac0ae8ee416 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:56.723700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0c98c36b-326c-4931-9718-aac0ae8ee416 None None] MFA Rules not processed for user `1f06fc34d5b54e558aa31f5b8f4d5afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:56.731663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0c98c36b-326c-4931-9718-aac0ae8ee416 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:56.788679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6c53bc5-82d5-407a-9703-0bbb8e4a297f service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:56.809942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:56.810815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:56.811094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:56.811351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] PATH_INFO: `/v3/projects/eb94a543db9a4d2b81cec0385ae48ea7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:56.821300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb94a543db9a4d2b81cec0385ae48ea7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:56.823249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:56.970102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb94a543db9a4d2b81cec0385ae48ea7', 'request_id': 'req-d0f14723-feb2-45cd-9414-b1c7d8af5d29'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:56.973741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 867/1721] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:56.986048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802841d7-c51b-430f-bb6c-7e60f2186c94 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:56.986751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802841d7-c51b-430f-bb6c-7e60f2186c94 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:56.987514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-802841d7-c51b-430f-bb6c-7e60f2186c94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:56.994892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb94a543db9a4d2b81cec0385ae48ea7', 'request_id': 'req-d0f14723-feb2-45cd-9414-b1c7d8af5d29'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.019111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb94a543db9a4d2b81cec0385ae48ea7', 'request_id': 'req-d0f14723-feb2-45cd-9414-b1c7d8af5d29'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.064591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] The token cache is being invalidate because project eb94a543db9a4d2b81cec0385ae48ea7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:36:57.064897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.067009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.070788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-802841d7-c51b-430f-bb6c-7e60f2186c94 None None] MFA Rules not processed for user `1f06fc34d5b54e558aa31f5b8f4d5afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:57.074598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-802841d7-c51b-430f-bb6c-7e60f2186c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:57.083780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 855/1722] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:36:56 2022] DELETE /identity/v3/projects/eb94a543db9a4d2b81cec0385ae48ea7 => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:57.090466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:57.092030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:57.313725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 868/1723] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:56 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:57.321406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802841d7-c51b-430f-bb6c-7e60f2186c94 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:57.323415 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-802841d7-c51b-430f-bb6c-7e60f2186c94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:57.367827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f14723-feb2-45cd-9414-b1c7d8af5d29 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:57.389245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:57.390266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:57.390558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:57.390831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] PATH_INFO: `/v3/users/e64a21ae8f7b472b80872a57523eb108` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:57.398762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e64a21ae8f7b472b80872a57523eb108)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:57.400750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:57.561594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:57.563766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:57.586524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e64a21ae8f7b472b80872a57523eb108'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.613111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-802841d7-c51b-430f-bb6c-7e60f2186c94 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:57.616167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e64a21ae8f7b472b80872a57523eb108'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.627644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbba8320-9f3e-47c3-97e2-2f29f9a3d9a2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:57.628417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8320-9f3e-47c3-97e2-2f29f9a3d9a2 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:57.628705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8320-9f3e-47c3-97e2-2f29f9a3d9a2 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:57.628981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbba8320-9f3e-47c3-97e2-2f29f9a3d9a2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:57.630014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e64a21ae8f7b472b80872a57523eb108'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.635221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dbba8320-9f3e-47c3-97e2-2f29f9a3d9a2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:57.656588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba8320-9f3e-47c3-97e2-2f29f9a3d9a2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:57.658031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e64a21ae8f7b472b80872a57523eb108'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.658733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7e1182d0-4d38-42ec-9d15-b1234ce6a2c8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e64a21ae8f7b472b80872a57523eb108'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:57.663125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbba8320-9f3e-47c3-97e2-2f29f9a3d9a2 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:57.668829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 856/1724] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:36:57 2022] DELETE /identity/v3/users/e64a21ae8f7b472b80872a57523eb108 => generated 0 bytes in 582 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:57.668829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617c3cc-a918-4dac-bb42-44c5e3b06585 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:57.668829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617c3cc-a918-4dac-bb42-44c5e3b06585 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:57.668829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6617c3cc-a918-4dac-bb42-44c5e3b06585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:57.712933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 869/1725] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 392 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:36:57.742876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6617c3cc-a918-4dac-bb42-44c5e3b06585 None None] MFA Rules not processed for user `0a028c1d97ce4951bdbb707b772baffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:57.744400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6617c3cc-a918-4dac-bb42-44c5e3b06585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:57.772244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264e33-b9a6-4080-9a12-a105c97052cf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:57.772695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264e33-b9a6-4080-9a12-a105c97052cf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:57.772695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79264e33-b9a6-4080-9a12-a105c97052cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:57.868383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-79264e33-b9a6-4080-9a12-a105c97052cf None None] MFA Rules not processed for user `060efd8407b3485eb67d4651006fc184`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:57.870360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-79264e33-b9a6-4080-9a12-a105c97052cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:58.008221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 870/1726] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:36:58.017970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 857/1727] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:57 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:58.023829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79264e33-b9a6-4080-9a12-a105c97052cf None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:58.025729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-79264e33-b9a6-4080-9a12-a105c97052cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:58.174690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79264e33-b9a6-4080-9a12-a105c97052cf None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:58.188488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0784ac-3ef0-4cea-9b74-64531e50c1a9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:58.189888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0784ac-3ef0-4cea-9b74-64531e50c1a9 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:58.190602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0784ac-3ef0-4cea-9b74-64531e50c1a9 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:58.191366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0784ac-3ef0-4cea-9b74-64531e50c1a9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:58.226322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0784ac-3ef0-4cea-9b74-64531e50c1a9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:58.229718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0784ac-3ef0-4cea-9b74-64531e50c1a9 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:58.247594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 871/1728] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:58.654146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617c3cc-a918-4dac-bb42-44c5e3b06585 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:58.656169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6617c3cc-a918-4dac-bb42-44c5e3b06585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:58.817690 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6617c3cc-a918-4dac-bb42-44c5e3b06585 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:58.827094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:58.828072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:58.828422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:58.828793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] PATH_INFO: `/v3/users/f1a6b091c0074cd7a6487b09a0cf6b1b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:58.830527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1a6b091c0074cd7a6487b09a0cf6b1b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:58.842995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:58.852589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f817ed-00e7-48cf-b418-184af834deb9 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:58.853122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f817ed-00e7-48cf-b418-184af834deb9 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:58.853808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f817ed-00e7-48cf-b418-184af834deb9 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:58.855541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 872/1729] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 12 08:36:58 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:36:58.862092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229c86-2be8-4d28-8859-5b6ac8ca5cb8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:58.862616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229c86-2be8-4d28-8859-5b6ac8ca5cb8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:58.863698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85229c86-2be8-4d28-8859-5b6ac8ca5cb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:59.027326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-85229c86-2be8-4d28-8859-5b6ac8ca5cb8 None None] MFA Rules not processed for user `686a32aea0b945d9a76875110c8f84ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:59.034001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1a6b091c0074cd7a6487b09a0cf6b1b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.034344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-85229c86-2be8-4d28-8859-5b6ac8ca5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:59.070442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:59.086987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1a6b091c0074cd7a6487b09a0cf6b1b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.108121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1a6b091c0074cd7a6487b09a0cf6b1b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.133162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1a6b091c0074cd7a6487b09a0cf6b1b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.133898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3ac931a-cb0e-4ec5-8199-f0f06fe74e49 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1a6b091c0074cd7a6487b09a0cf6b1b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.144036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 858/1730] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:36:58 2022] DELETE /identity/v3/users/f1a6b091c0074cd7a6487b09a0cf6b1b => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:59.149212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e6ff-ba01-40f9-bc0a-16e9ce2d3bc4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:59.149470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e6ff-ba01-40f9-bc0a-16e9ce2d3bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:59.149750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9e6e6ff-ba01-40f9-bc0a-16e9ce2d3bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:59.152667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:36:59.183574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e9e6e6ff-ba01-40f9-bc0a-16e9ce2d3bc4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:59.185022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9e6e6ff-ba01-40f9-bc0a-16e9ce2d3bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:59.223052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 873/1731] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:36:58 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 362 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:59.288339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 859/1732] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:36:59.389030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229c86-2be8-4d28-8859-5b6ac8ca5cb8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:59.391798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-85229c86-2be8-4d28-8859-5b6ac8ca5cb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:59.410452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85229c86-2be8-4d28-8859-5b6ac8ca5cb8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:59.431825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6e6ff-ba01-40f9-bc0a-16e9ce2d3bc4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:59.530240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:59.531731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:59.533177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:59.533328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:59.558500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:59.560335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:59.581268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 874/1733] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:59.588191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9e6e6ff-ba01-40f9-bc0a-16e9ce2d3bc4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:59.590220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:36:59.591732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:59.598552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e27f404-c171-44b1-8174-e5cf7d8a6b7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:59.600612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f404-c171-44b1-8174-e5cf7d8a6b7b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:59.603467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f404-c171-44b1-8174-e5cf7d8a6b7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:59.603941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e27f404-c171-44b1-8174-e5cf7d8a6b7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:59.622519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-354aa35a-e30a-4159-942c-aab4cf498a05 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:36:59.637159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:36:59.638947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:59.639448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:59.639965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] PATH_INFO: `/v3/projects/1ef65e5c73d848a48c1cca28f3aba638` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:59.642938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] RBAC: Authorizing `identity:delete_project(project_id=1ef65e5c73d848a48c1cca28f3aba638)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:59.644521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27f404-c171-44b1-8174-e5cf7d8a6b7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:36:59.651062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:59.651544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e27f404-c171-44b1-8174-e5cf7d8a6b7b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:36:59.689472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 860/1734] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:36:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:36:59.797160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1ef65e5c73d848a48c1cca28f3aba638', 'request_id': 'req-67e19cbd-2143-4b33-af1c-7d4d2cef854d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.812467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1ef65e5c73d848a48c1cca28f3aba638', 'request_id': 'req-67e19cbd-2143-4b33-af1c-7d4d2cef854d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.864870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1ef65e5c73d848a48c1cca28f3aba638', 'request_id': 'req-67e19cbd-2143-4b33-af1c-7d4d2cef854d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.906372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] The token cache is being invalidate because project 1ef65e5c73d848a48c1cca28f3aba638 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:36:59.906372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.908214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-67e19cbd-2143-4b33-af1c-7d4d2cef854d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:36:59.916068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 875/1735] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:36:59 2022] DELETE /identity/v3/projects/1ef65e5c73d848a48c1cca28f3aba638 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:36:59.917409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ce197-467d-45a6-9efa-0882a8a21efe None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:59.919621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ce197-467d-45a6-9efa-0882a8a21efe None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:59.919827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1ce197-467d-45a6-9efa-0882a8a21efe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:59.957980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ed5d2-9a68-41d9-86bb-c1c0eefa827e None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:59.958489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ed5d2-9a68-41d9-86bb-c1c0eefa827e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:59.958920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3ed5d2-9a68-41d9-86bb-c1c0eefa827e None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:36:59.961464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 876/1736] 10.222.0.20 () {54 vars in 912 bytes} [Tue Jul 12 08:36:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:36:59.967041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ad1ce197-467d-45a6-9efa-0882a8a21efe None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:36:59.968318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ad1ce197-467d-45a6-9efa-0882a8a21efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:36:59.982317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aeffc-1c00-4f17-aada-5240e15e5ee1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:36:59.982689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aeffc-1c00-4f17-aada-5240e15e5ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:36:59.983004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a5aeffc-1c00-4f17-aada-5240e15e5ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.068601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2a5aeffc-1c00-4f17-aada-5240e15e5ee1 None None] MFA Rules not processed for user `686a32aea0b945d9a76875110c8f84ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:00.069895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2a5aeffc-1c00-4f17-aada-5240e15e5ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:00.198104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 861/1737] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:36:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 282 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:00.199863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93bd3b-528d-4f3e-91df-97dd966680f2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:00.200162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93bd3b-528d-4f3e-91df-97dd966680f2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:00.200449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee93bd3b-528d-4f3e-91df-97dd966680f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.263463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ee93bd3b-528d-4f3e-91df-97dd966680f2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:00.267559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ee93bd3b-528d-4f3e-91df-97dd966680f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:00.269711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 877/1738] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:36:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 288 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:00.286952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 862/1739] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:00.292166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aeffc-1c00-4f17-aada-5240e15e5ee1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:00.315207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a5aeffc-1c00-4f17-aada-5240e15e5ee1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:00.326203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:00.327066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:00.327462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:00.328047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.328704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:00.341453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:00.343417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:00.361307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 878/1740] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:00.366539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93bd3b-528d-4f3e-91df-97dd966680f2 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:00.378364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee93bd3b-528d-4f3e-91df-97dd966680f2 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:00.390626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:00.391319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:00.391603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:00.391882 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.393903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:00.400973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:00.445593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:00.515484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 863/1741] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:00 2022] POST /identity/v3/projects => generated 387 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:00.519594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:00.542484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a499b3-ffbd-440d-8ef5-a47c79daccc1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:00.574891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:00.632803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:00.635279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:00.701619 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae111e5-ec50-4052-9195-9a8e0d607d28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:00.702318 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae111e5-ec50-4052-9195-9a8e0d607d28 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:00.702605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae111e5-ec50-4052-9195-9a8e0d607d28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:00.702880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ae111e5-ec50-4052-9195-9a8e0d607d28 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.703580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae111e5-ec50-4052-9195-9a8e0d607d28 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:00.713979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ae111e5-ec50-4052-9195-9a8e0d607d28 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:00.773529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 879/1742] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:00 2022] POST /identity/v3/users => generated 294 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:00.774965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0bf619b-db03-434e-bfd0-e6e91b81f7c9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:00.778817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae111e5-ec50-4052-9195-9a8e0d607d28 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:00.781862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0407e-65e1-4155-9ba4-4f949ea36ab4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:00.781862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0407e-65e1-4155-9ba4-4f949ea36ab4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:00.781862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0407e-65e1-4155-9ba4-4f949ea36ab4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:00.781862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f0407e-65e1-4155-9ba4-4f949ea36ab4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.793787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0407e-65e1-4155-9ba4-4f949ea36ab4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:00.796184 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f0407e-65e1-4155-9ba4-4f949ea36ab4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:00.804768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ae111e5-ec50-4052-9195-9a8e0d607d28 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:00.817207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 864/1743] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 187 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:00.820884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99f297-334a-4c55-b71b-6f729ee556ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:00.821783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99f297-334a-4c55-b71b-6f729ee556ca admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:00.822188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99f297-334a-4c55-b71b-6f729ee556ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:00.822570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf99f297-334a-4c55-b71b-6f729ee556ca admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.823529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99f297-334a-4c55-b71b-6f729ee556ca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:00.825638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf99f297-334a-4c55-b71b-6f729ee556ca admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:00.851356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 880/1744] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:00.855793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0407e-65e1-4155-9ba4-4f949ea36ab4 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:00.874195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f0407e-65e1-4155-9ba4-4f949ea36ab4 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:00.879768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c1fd35d-09ff-4580-ade9-25156b405fee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:00.880444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fd35d-09ff-4580-ade9-25156b405fee admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:00.880728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fd35d-09ff-4580-ade9-25156b405fee admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:00.881084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c1fd35d-09ff-4580-ade9-25156b405fee admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.882589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fd35d-09ff-4580-ade9-25156b405fee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:00.884219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c1fd35d-09ff-4580-ade9-25156b405fee admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:00.900093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 865/1745] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:00 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:00.905157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99f297-334a-4c55-b71b-6f729ee556ca admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:00.922545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf99f297-334a-4c55-b71b-6f729ee556ca admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:00.937066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb85ea8a-6e59-4f12-bb93-f7947dff6984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:00.939040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ea8a-6e59-4f12-bb93-f7947dff6984 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:00.939185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ea8a-6e59-4f12-bb93-f7947dff6984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:00.939410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb85ea8a-6e59-4f12-bb93-f7947dff6984 admin admin] PATH_INFO: `/v3/projects/2325f95bf8cb40dfa783daa514d2d2d1/users/41ebdf8c45b143a690001e3ee3122d23/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:00.984268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85ea8a-6e59-4f12-bb93-f7947dff6984 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2325f95bf8cb40dfa783daa514d2d2d1, user_id=41ebdf8c45b143a690001e3ee3122d23, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:00.992895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb85ea8a-6e59-4f12-bb93-f7947dff6984 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:01.030036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 881/1746] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:00 2022] PUT /identity/v3/projects/2325f95bf8cb40dfa783daa514d2d2d1/users/41ebdf8c45b143a690001e3ee3122d23/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:01.040877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aae03-613e-4bc6-8b97-318f7e970e79 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:01.041939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aae03-613e-4bc6-8b97-318f7e970e79 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:01.042847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32aae03-613e-4bc6-8b97-318f7e970e79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:01.106277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c32aae03-613e-4bc6-8b97-318f7e970e79 None None] MFA Rules not processed for user `41ebdf8c45b143a690001e3ee3122d23`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:01.108907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c32aae03-613e-4bc6-8b97-318f7e970e79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:01.154006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4be9-c054-4c5d-9543-33e8856363ea None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:01.154659 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4be9-c054-4c5d-9543-33e8856363ea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:01.155204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ee4be9-c054-4c5d-9543-33e8856363ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:01.199030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f4ee4be9-c054-4c5d-9543-33e8856363ea None None] MFA Rules not processed for user `e037c38a998240b293910049cfe37799`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:01.203210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f4ee4be9-c054-4c5d-9543-33e8856363ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:01.309927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 866/1747] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:01.315048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9388b9-6386-4f1f-9d49-9961fefefb54 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:01.315331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9388b9-6386-4f1f-9d49-9961fefefb54 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:01.316036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9388b9-6386-4f1f-9d49-9961fefefb54 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:01.328465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 867/1748] 10.222.0.20 () {54 vars in 960 bytes} [Tue Jul 12 08:37:01 2022] GET /identity => generated 270 bytes in 18 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:37:01.329666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9388b9-6386-4f1f-9d49-9961fefefb54 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:01.391960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 882/1749] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:01 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:01.391960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8886d-71bb-4534-b78f-0c813ad23726 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:01.391960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8886d-71bb-4534-b78f-0c813ad23726 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:01.391960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da8886d-71bb-4534-b78f-0c813ad23726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:01.449226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8da8886d-71bb-4534-b78f-0c813ad23726 None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:01.450530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8da8886d-71bb-4534-b78f-0c813ad23726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:01.538736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9388b9-6386-4f1f-9d49-9961fefefb54 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:01.549411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d9b53b5-2678-4ed4-9d22-b6f564151169 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:01.550223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b53b5-2678-4ed4-9d22-b6f564151169 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:01.550574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b53b5-2678-4ed4-9d22-b6f564151169 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:01.550918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d9b53b5-2678-4ed4-9d22-b6f564151169 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:01.551705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b53b5-2678-4ed4-9d22-b6f564151169 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:01.554314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d9b53b5-2678-4ed4-9d22-b6f564151169 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:01.602675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:01.615749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 868/1750] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:01 2022] POST /identity/v3/projects => generated 389 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:01.620395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46071-4c7f-49bf-959f-7d14e32f9cdd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:01.621272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46071-4c7f-49bf-959f-7d14e32f9cdd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:01.624318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede46071-4c7f-49bf-959f-7d14e32f9cdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:01.685143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ede46071-4c7f-49bf-959f-7d14e32f9cdd None None] MFA Rules not processed for user `1f06fc34d5b54e558aa31f5b8f4d5afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:01.695312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ede46071-4c7f-49bf-959f-7d14e32f9cdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:01.711861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 883/1751] 10.222.0.20 () {58 vars in 1057 bytes} [Tue Jul 12 08:37:01 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 323 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:01.716264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c190-b236-4454-9cce-a5f2b232b27e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:01.717552 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c190-b236-4454-9cce-a5f2b232b27e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:01.722046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045c190-b236-4454-9cce-a5f2b232b27e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:01.752548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:01.817934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d045c190-b236-4454-9cce-a5f2b232b27e None None] MFA Rules not processed for user `536ab924a5e049bfa8ee1a723d801d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:01.821900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d045c190-b236-4454-9cce-a5f2b232b27e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:01.893485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 869/1752] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:01 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 277 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:01.896821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede46071-4c7f-49bf-959f-7d14e32f9cdd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:02.016178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 884/1753] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:01 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 304 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:02.017195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045c190-b236-4454-9cce-a5f2b232b27e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:02.079929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede46071-4c7f-49bf-959f-7d14e32f9cdd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:02.100309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:02.101090 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:02.101375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:02.102534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:02.103272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:02.105317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:02.153965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 870/1754] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:01 2022] POST /identity/v3/users => generated 301 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:02.155159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:02.156791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045c190-b236-4454-9cce-a5f2b232b27e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:02.160319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:02.171605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ae8c67-e1f7-4aab-bb2f-30e221bda422 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:02.172750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae8c67-e1f7-4aab-bb2f-30e221bda422 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:02.172750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae8c67-e1f7-4aab-bb2f-30e221bda422 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:02.172952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ae8c67-e1f7-4aab-bb2f-30e221bda422 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:02.188679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b6d644-44af-4f6c-b15d-e6ac2f0078fe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:02.192721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-22ae8c67-e1f7-4aab-bb2f-30e221bda422 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:02.201335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:02.202414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:02.202643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:02.202922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] PATH_INFO: `/v3/projects/a4b0ea7bcd0e4d66a6b2f964f4c6d068` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:02.204629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4b0ea7bcd0e4d66a6b2f964f4c6d068)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:02.210689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:02.217449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae8c67-e1f7-4aab-bb2f-30e221bda422 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:02.219156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ae8c67-e1f7-4aab-bb2f-30e221bda422 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:02.250045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 885/1755] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:02.252992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c905b22-aaa8-44a9-948c-6eef551ccf47 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:02.260176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c905b22-aaa8-44a9-948c-6eef551ccf47 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:02.260509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c905b22-aaa8-44a9-948c-6eef551ccf47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:02.326484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0c905b22-aaa8-44a9-948c-6eef551ccf47 None None] MFA Rules not processed for user `536ab924a5e049bfa8ee1a723d801d7e`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:02.335704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0c905b22-aaa8-44a9-948c-6eef551ccf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:02.348410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4b0ea7bcd0e4d66a6b2f964f4c6d068', 'request_id': 'req-c16cac5e-9f76-42db-b1fa-96f70e6082a3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:02.359833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4b0ea7bcd0e4d66a6b2f964f4c6d068', 'request_id': 'req-c16cac5e-9f76-42db-b1fa-96f70e6082a3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:02.385756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4b0ea7bcd0e4d66a6b2f964f4c6d068', 'request_id': 'req-c16cac5e-9f76-42db-b1fa-96f70e6082a3'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:02.432661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] The token cache is being invalidate because project a4b0ea7bcd0e4d66a6b2f964f4c6d068 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:02.433980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:02.437918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:02.441217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 871/1756] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:02 2022] DELETE /identity/v3/projects/a4b0ea7bcd0e4d66a6b2f964f4c6d068 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:02.446712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:02.460531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:02.515889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:02.586624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 886/1757] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:02 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:02.588619 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c905b22-aaa8-44a9-948c-6eef551ccf47 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:02.589946 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0c905b22-aaa8-44a9-948c-6eef551ccf47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:02.636335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16cac5e-9f76-42db-b1fa-96f70e6082a3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:02.656292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d9d3d-c3bd-456a-a692-d41df64c93de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:02.657257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9d3d-c3bd-456a-a692-d41df64c93de admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:02.657633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9d3d-c3bd-456a-a692-d41df64c93de admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:02.658597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323d9d3d-c3bd-456a-a692-d41df64c93de admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:02.658784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d9d3d-c3bd-456a-a692-d41df64c93de admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:02.660458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323d9d3d-c3bd-456a-a692-d41df64c93de admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:02.687690 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 872/1758] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:02.699681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d9d3d-c3bd-456a-a692-d41df64c93de admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:02.717521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323d9d3d-c3bd-456a-a692-d41df64c93de admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:02.720160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:02.730498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911470c6-af18-4b45-8644-e4761f051d68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:02.731412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911470c6-af18-4b45-8644-e4761f051d68 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:02.731696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911470c6-af18-4b45-8644-e4761f051d68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:02.731976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911470c6-af18-4b45-8644-e4761f051d68 admin admin] PATH_INFO: `/v3/projects/b757ca53551643b0aad2e5b9e687e4c3/users/bede53dc2a2d4315ae48f048c0edf157/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:02.787084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911470c6-af18-4b45-8644-e4761f051d68 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b757ca53551643b0aad2e5b9e687e4c3, user_id=bede53dc2a2d4315ae48f048c0edf157, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:02.790430 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911470c6-af18-4b45-8644-e4761f051d68 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:02.804397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c905b22-aaa8-44a9-948c-6eef551ccf47 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:02.820093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 873/1759] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:02 2022] PUT /identity/v3/projects/b757ca53551643b0aad2e5b9e687e4c3/users/bede53dc2a2d4315ae48f048c0edf157/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:02.821803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911470c6-af18-4b45-8644-e4761f051d68 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:02.828731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:02.829790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:02.830176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:02.830553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] PATH_INFO: `/v3/users/e19afbfaed694f1ba3daecdb23bede6f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:02.838348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e19afbfaed694f1ba3daecdb23bede6f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:02.840930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:02.900080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911470c6-af18-4b45-8644-e4761f051d68 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:02.905984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9352653-e780-4791-adc6-ec842fddab0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:02.906672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352653-e780-4791-adc6-ec842fddab0d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:02.907277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352653-e780-4791-adc6-ec842fddab0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:02.907558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9352653-e780-4791-adc6-ec842fddab0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:02.908298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9352653-e780-4791-adc6-ec842fddab0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:02.910075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9352653-e780-4791-adc6-ec842fddab0d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:02.949006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e19afbfaed694f1ba3daecdb23bede6f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:02.953791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 874/1760] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:02 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:02.961295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9352653-e780-4791-adc6-ec842fddab0d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:02.968676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e19afbfaed694f1ba3daecdb23bede6f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:02.988511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9352653-e780-4791-adc6-ec842fddab0d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:02.993383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e19afbfaed694f1ba3daecdb23bede6f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:03.005015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:03.006602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:03.007338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:03.007512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] PATH_INFO: `/v3/projects/b757ca53551643b0aad2e5b9e687e4c3/users/bede53dc2a2d4315ae48f048c0edf157/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:03.014126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b757ca53551643b0aad2e5b9e687e4c3, user_id=bede53dc2a2d4315ae48f048c0edf157, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:03.018001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:03.020190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e19afbfaed694f1ba3daecdb23bede6f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:03.023821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8b3fc458-c09f-45b3-9391-a957ac52df31 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e19afbfaed694f1ba3daecdb23bede6f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:03.044489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 887/1761] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:02 2022] DELETE /identity/v3/users/e19afbfaed694f1ba3daecdb23bede6f => generated 0 bytes in 455 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:03.045682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 875/1762] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:02 2022] PUT /identity/v3/projects/b757ca53551643b0aad2e5b9e687e4c3/users/bede53dc2a2d4315ae48f048c0edf157/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 83 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:03.056158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232b84-9bbc-4e71-9923-27de00486231 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:03.056447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232b84-9bbc-4e71-9923-27de00486231 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:03.056788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af232b84-9bbc-4e71-9923-27de00486231 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:03.097496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-af232b84-9bbc-4e71-9923-27de00486231 None None] MFA Rules not processed for user `bede53dc2a2d4315ae48f048c0edf157`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:03.098887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af232b84-9bbc-4e71-9923-27de00486231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:03.266598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 888/1763] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:03 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 210 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:03.276587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:03.278706 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:03.410890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abdcd7d0-0520-4cbd-9dbf-29bfe83c4d19 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:03.420651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:03.422061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:03.422355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:03.422657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:03.443269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:03.446230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:03.492379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 876/1764] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:03 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:03.859217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af232b84-9bbc-4e71-9923-27de00486231 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:03.863403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af232b84-9bbc-4e71-9923-27de00486231 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:03.877005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:03.878568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:03.947422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:04.015654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:04.157581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d7f4ee-0071-408e-93b7-5d33b85800e1 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:04.172766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:04.173926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:04.175365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:04.175793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] PATH_INFO: `/v3/users/41ebdf8c45b143a690001e3ee3122d23` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:04.184622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ebdf8c45b143a690001e3ee3122d23)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:04.186705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:04.218063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af232b84-9bbc-4e71-9923-27de00486231 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:04.249609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:04.255412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:04.259061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:04.259755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:04.268779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:04.450033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ebdf8c45b143a690001e3ee3122d23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:04.518545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ebdf8c45b143a690001e3ee3122d23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:04.530981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ebdf8c45b143a690001e3ee3122d23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:04.544134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ebdf8c45b143a690001e3ee3122d23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:04.546419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cc403e2a-88a8-422b-8414-3ede0002276f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ebdf8c45b143a690001e3ee3122d23'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:04.560692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 877/1765] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:03 2022] DELETE /identity/v3/users/41ebdf8c45b143a690001e3ee3122d23 => generated 0 bytes in 684 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:04.569470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0128f-52eb-492d-bdef-014b3d0e8d0a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:04.569470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0128f-52eb-492d-bdef-014b3d0e8d0a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:04.572592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bf0128f-52eb-492d-bdef-014b3d0e8d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:04.601157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:04.605476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:04.627852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1bf0128f-52eb-492d-bdef-014b3d0e8d0a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:04.630993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1bf0128f-52eb-492d-bdef-014b3d0e8d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:04.653574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 889/1766] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:03 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 794 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:04.750487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 878/1767] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:04.762749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:04.765794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:04.971805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61abd8b7-6433-43e5-a594-cc28d5cd0fa0 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:05.099613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:05.100429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:05.100715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:05.102689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:05.154911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:05.164730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:05.234803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 890/1768] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:05.846382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc301-c406-418b-b77a-3b9238bf6194 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:05.846927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc301-c406-418b-b77a-3b9238bf6194 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:05.851125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a7cc301-c406-418b-b77a-3b9238bf6194 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:05.932935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7a7cc301-c406-418b-b77a-3b9238bf6194 None None] MFA Rules not processed for user `060efd8407b3485eb67d4651006fc184`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:05.933887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:05.934643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7a7cc301-c406-418b-b77a-3b9238bf6194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:05.935313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:05.967827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebeea6e6-61b5-4d2d-912c-d0d17af01b8e service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:05.983579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:05.985060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:05.999156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:06.000205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:06.000661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] PATH_INFO: `/v3/projects/ee45d7b779314b35b58c384e67c05b0c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:06.002298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee45d7b779314b35b58c384e67c05b0c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:06.006890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:06.074543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 879/1769] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:05 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:06.085892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:06.130109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee45d7b779314b35b58c384e67c05b0c', 'request_id': 'req-ce731ff7-41ac-4722-a74e-84ed8b2c555b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.143929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee45d7b779314b35b58c384e67c05b0c', 'request_id': 'req-ce731ff7-41ac-4722-a74e-84ed8b2c555b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.161394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cc301-c406-418b-b77a-3b9238bf6194 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:06.163356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7a7cc301-c406-418b-b77a-3b9238bf6194 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:06.169302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee45d7b779314b35b58c384e67c05b0c', 'request_id': 'req-ce731ff7-41ac-4722-a74e-84ed8b2c555b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.190469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] The token cache is being invalidate because project ee45d7b779314b35b58c384e67c05b0c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:06.190991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.191848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ce731ff7-41ac-4722-a74e-84ed8b2c555b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.197335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 891/1770] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:05 2022] DELETE /identity/v3/projects/ee45d7b779314b35b58c384e67c05b0c => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:06.198992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a7cc301-c406-418b-b77a-3b9238bf6194 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:06.199108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acddeb-dcd5-4e9b-a7c3-d1f8933e394e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:06.199108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acddeb-dcd5-4e9b-a7c3-d1f8933e394e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:06.199327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56acddeb-dcd5-4e9b-a7c3-d1f8933e394e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:06.244384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-56acddeb-dcd5-4e9b-a7c3-d1f8933e394e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:06.246568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-56acddeb-dcd5-4e9b-a7c3-d1f8933e394e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:06.309179 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:06.310700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:06.311227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:06.311785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] PATH_INFO: `/v3/projects/2325f95bf8cb40dfa783daa514d2d2d1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:06.313968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] RBAC: Authorizing `identity:delete_project(project_id=2325f95bf8cb40dfa783daa514d2d2d1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:06.316162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:06.372705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 892/1771] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:06.387393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b9af6-5e8b-43fa-8b6a-56ced60b8e67 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:06.388321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b9af6-5e8b-43fa-8b6a-56ced60b8e67 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:06.388794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53b9af6-5e8b-43fa-8b6a-56ced60b8e67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:06.465642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2325f95bf8cb40dfa783daa514d2d2d1', 'request_id': 'req-177539ae-001a-49ba-95cd-0f57d3fee72c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.483512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2325f95bf8cb40dfa783daa514d2d2d1', 'request_id': 'req-177539ae-001a-49ba-95cd-0f57d3fee72c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.486444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b53b9af6-5e8b-43fa-8b6a-56ced60b8e67 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:06.487948 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b53b9af6-5e8b-43fa-8b6a-56ced60b8e67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:06.517550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2325f95bf8cb40dfa783daa514d2d2d1', 'request_id': 'req-177539ae-001a-49ba-95cd-0f57d3fee72c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.562752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] The token cache is being invalidate because project 2325f95bf8cb40dfa783daa514d2d2d1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:06.562991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.570295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:06.581280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 880/1772] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:06 2022] DELETE /identity/v3/projects/2325f95bf8cb40dfa783daa514d2d2d1 => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:06.584718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:06.589737 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:06.627343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 893/1773] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:06.632188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b9af6-5e8b-43fa-8b6a-56ced60b8e67 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:06.659272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53b9af6-5e8b-43fa-8b6a-56ced60b8e67 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:06.682171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:06.683103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:06.683559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:06.683974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:06.684848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:06.685323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:06.687127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:06.722127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 894/1774] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:37:06.723067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:06.746804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a1a6401-19a6-42b2-8f08-73baf67562c6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:06.767465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb35859-a1cc-4981-8139-12c94707ee4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:06.768168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35859-a1cc-4981-8139-12c94707ee4d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:06.768452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35859-a1cc-4981-8139-12c94707ee4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:06.768764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb35859-a1cc-4981-8139-12c94707ee4d admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:06.774353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb35859-a1cc-4981-8139-12c94707ee4d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:06.778154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb35859-a1cc-4981-8139-12c94707ee4d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:06.840664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177539ae-001a-49ba-95cd-0f57d3fee72c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:06.862257 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 895/1775] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:06 2022] POST /identity/v3/projects => generated 379 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:06.868026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb35859-a1cc-4981-8139-12c94707ee4d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:06.872752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:06.873931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:06.874693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:06.876148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] PATH_INFO: `/v3/users/bede53dc2a2d4315ae48f048c0edf157` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:06.883182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] RBAC: Authorizing `identity:delete_user(user_id=bede53dc2a2d4315ae48f048c0edf157)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:06.890014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:06.936636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:06.953130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:07.092796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bede53dc2a2d4315ae48f048c0edf157'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:07.112935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb35859-a1cc-4981-8139-12c94707ee4d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:07.131572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdcad-aafc-4db0-8e0c-4a9515029701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:07.132398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdcad-aafc-4db0-8e0c-4a9515029701 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:07.132679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdcad-aafc-4db0-8e0c-4a9515029701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:07.134551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33bdcad-aafc-4db0-8e0c-4a9515029701 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:07.135475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdcad-aafc-4db0-8e0c-4a9515029701 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:07.141238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bede53dc2a2d4315ae48f048c0edf157'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:07.142836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33bdcad-aafc-4db0-8e0c-4a9515029701 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:07.154250 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bede53dc2a2d4315ae48f048c0edf157'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:07.166318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bede53dc2a2d4315ae48f048c0edf157'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:07.167523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bede53dc2a2d4315ae48f048c0edf157'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:07.184900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 896/1777] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:06 2022] POST /identity/v3/users => generated 290 bytes in 318 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:07.187979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 881/1777] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:06 2022] DELETE /identity/v3/users/bede53dc2a2d4315ae48f048c0edf157 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:07.191580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:07.193770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:07.362815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78403ae2-51b5-434e-885d-85750af649da admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:07.375806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e10e7-3adb-4b8a-81e0-6182091c13cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:07.378052 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e10e7-3adb-4b8a-81e0-6182091c13cf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:07.378353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e10e7-3adb-4b8a-81e0-6182091c13cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:07.378699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce9e10e7-3adb-4b8a-81e0-6182091c13cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:07.380830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e10e7-3adb-4b8a-81e0-6182091c13cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:07.386390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce9e10e7-3adb-4b8a-81e0-6182091c13cf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:07.414209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 882/1778] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:07.428048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdcad-aafc-4db0-8e0c-4a9515029701 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:07.449319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33bdcad-aafc-4db0-8e0c-4a9515029701 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:07.461832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4c8ac4-3a16-482e-913f-3e11f45c2547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:07.462517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8ac4-3a16-482e-913f-3e11f45c2547 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:07.462804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8ac4-3a16-482e-913f-3e11f45c2547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:07.463164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4c8ac4-3a16-482e-913f-3e11f45c2547 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:07.463912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8ac4-3a16-482e-913f-3e11f45c2547 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:07.470261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4c8ac4-3a16-482e-913f-3e11f45c2547 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:07.498526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 897/1779] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:07 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:07.499887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e10e7-3adb-4b8a-81e0-6182091c13cf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:07.566509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce9e10e7-3adb-4b8a-81e0-6182091c13cf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:07.604883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c48a68c-1033-4d44-b47e-6226b1ec0c1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:07.609549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a68c-1033-4d44-b47e-6226b1ec0c1e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:07.610539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a68c-1033-4d44-b47e-6226b1ec0c1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:07.612571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c48a68c-1033-4d44-b47e-6226b1ec0c1e admin admin] PATH_INFO: `/v3/projects/4b8c6b8e2b6d47338ee7cc1dc3def6a4/users/db433d707bc74024bee736a29308760a/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:07.664312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48a68c-1033-4d44-b47e-6226b1ec0c1e admin admin] RBAC: Authorizing `identity:create_grant(project_id=4b8c6b8e2b6d47338ee7cc1dc3def6a4, user_id=db433d707bc74024bee736a29308760a, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:07.674329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c48a68c-1033-4d44-b47e-6226b1ec0c1e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:07.722345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 883/1780] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:07 2022] PUT /identity/v3/projects/4b8c6b8e2b6d47338ee7cc1dc3def6a4/users/db433d707bc74024bee736a29308760a/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:07.724115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7861e1-9851-4b11-8aac-83da6d5c658b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:07.724608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7861e1-9851-4b11-8aac-83da6d5c658b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:07.725673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7861e1-9851-4b11-8aac-83da6d5c658b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:07.782137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-aa7861e1-9851-4b11-8aac-83da6d5c658b None None] MFA Rules not processed for user `db433d707bc74024bee736a29308760a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:07.783974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aa7861e1-9851-4b11-8aac-83da6d5c658b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:07.987094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feea94e-c161-478d-ba1a-24c9f84982c3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:07.987971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feea94e-c161-478d-ba1a-24c9f84982c3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:07.988446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0feea94e-c161-478d-ba1a-24c9f84982c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:08.008061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 898/1781] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:07 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:08.012892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7861e1-9851-4b11-8aac-83da6d5c658b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:08.111321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0feea94e-c161-478d-ba1a-24c9f84982c3 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:08.112684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0feea94e-c161-478d-ba1a-24c9f84982c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:08.194442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7861e1-9851-4b11-8aac-83da6d5c658b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:08.212337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=10,keystone:SELECT=88,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:08.217265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61a335-c2e7-4f6b-8e34-11e7ad036f16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:08.218134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61a335-c2e7-4f6b-8e34-11e7ad036f16 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:08.218249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61a335-c2e7-4f6b-8e34-11e7ad036f16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:08.218770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d61a335-c2e7-4f6b-8e34-11e7ad036f16 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:08.219218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61a335-c2e7-4f6b-8e34-11e7ad036f16 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:08.221161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d61a335-c2e7-4f6b-8e34-11e7ad036f16 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:08.303223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 899/1782] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:08 2022] POST /identity/v3/projects => generated 379 bytes in 288 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:08.305031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61a335-c2e7-4f6b-8e34-11e7ad036f16 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:08.377009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 884/1783] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:37:07 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 392 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:08.395586 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:08.544277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d61a335-c2e7-4f6b-8e34-11e7ad036f16 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:08.571746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:08.574041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:08.574459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:08.574905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:08.576220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:08.578547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:08.618855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 900/1784] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:08 2022] POST /identity/v3/users => generated 296 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:37:08.622345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feea94e-c161-478d-ba1a-24c9f84982c3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:08.652662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0feea94e-c161-478d-ba1a-24c9f84982c3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:08.661284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c587224-1620-4d56-beb8-4394fc0040bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:08.662962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587224-1620-4d56-beb8-4394fc0040bf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:08.663429 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587224-1620-4d56-beb8-4394fc0040bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:08.663710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c587224-1620-4d56-beb8-4394fc0040bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:08.664455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c587224-1620-4d56-beb8-4394fc0040bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:08.681374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c587224-1620-4d56-beb8-4394fc0040bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:08.704291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:08.705582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 885/1785] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:08 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:08.706694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:08.709744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c587224-1620-4d56-beb8-4394fc0040bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:08.728744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c587224-1620-4d56-beb8-4394fc0040bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:08.742448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:08.743850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:08.744509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:08.747129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] PATH_INFO: `/v3/projects/7727e104c7f248e7964d2da0e1e2de66/users/d8d88454e9c44195a17688ed16347e18/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:08.750937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d9de3f1-e581-4a2b-9f9a-c6f54b715b6a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:08.775138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:08.776087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:08.776420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:08.776693 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] PATH_INFO: `/v3/users/85aea04f956341d489fbab27b5612724` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:08.779925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85aea04f956341d489fbab27b5612724)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:08.784193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:08.815549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7727e104c7f248e7964d2da0e1e2de66, user_id=d8d88454e9c44195a17688ed16347e18, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:08.822106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:08.849630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 886/1786] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:08 2022] PUT /identity/v3/projects/7727e104c7f248e7964d2da0e1e2de66/users/d8d88454e9c44195a17688ed16347e18/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:08.850762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:08.858879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:08.941726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85aea04f956341d489fbab27b5612724'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:08.983892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85aea04f956341d489fbab27b5612724'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:09.004973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85aea04f956341d489fbab27b5612724'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:09.050266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85aea04f956341d489fbab27b5612724'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:09.051574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85aea04f956341d489fbab27b5612724'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:09.077727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 901/1787] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:08 2022] DELETE /identity/v3/users/85aea04f956341d489fbab27b5612724 => generated 0 bytes in 374 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:09.078700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:09.082502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:09.136515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824b8475-6258-4d69-ae32-342c008547e3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:09.281798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a505a2db-42a2-4b6b-831c-9dc248ece5f0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:09.282432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963166c-40b4-412b-9805-937634da633c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:09.283114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963166c-40b4-412b-9805-937634da633c service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:09.283405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963166c-40b4-412b-9805-937634da633c service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:09.283672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b963166c-40b4-412b-9805-937634da633c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:09.285841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b963166c-40b4-412b-9805-937634da633c service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:09.304656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49e869e7-9b82-4991-8457-51c0bacdef02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:09.305357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e869e7-9b82-4991-8457-51c0bacdef02 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:09.305807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e869e7-9b82-4991-8457-51c0bacdef02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:09.305915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49e869e7-9b82-4991-8457-51c0bacdef02 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:09.306798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e869e7-9b82-4991-8457-51c0bacdef02 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:09.310173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49e869e7-9b82-4991-8457-51c0bacdef02 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:09.348474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:09.364092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 902/1788] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:09 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:09.365760 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e27e4-f815-42b0-9158-431152e979bf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:09.366108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e27e4-f815-42b0-9158-431152e979bf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:09.366334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7e27e4-f815-42b0-9158-431152e979bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:09.428101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6d7e27e4-f815-42b0-9158-431152e979bf None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:09.433098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6d7e27e4-f815-42b0-9158-431152e979bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:09.433639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963166c-40b4-412b-9805-937634da633c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:09.442487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b963166c-40b4-412b-9805-937634da633c service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:09.457215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 887/1789] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:37:08 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 607 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:37:09.459356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963166c-40b4-412b-9805-937634da633c service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:09.480672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 903/1790] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:09.494233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b963166c-40b4-412b-9805-937634da633c service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:09.509755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:09.510888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:09.511726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:09.513066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] PATH_INFO: `/v3/projects/7727e104c7f248e7964d2da0e1e2de66/users/d8d88454e9c44195a17688ed16347e18/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:09.519462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7727e104c7f248e7964d2da0e1e2de66, user_id=d8d88454e9c44195a17688ed16347e18, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:09.524358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:09.565624 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 888/1791] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:09 2022] PUT /identity/v3/projects/7727e104c7f248e7964d2da0e1e2de66/users/d8d88454e9c44195a17688ed16347e18/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:09.579803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55183-ab80-4a2f-ac69-90b230c0ee15 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:09.580461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55183-ab80-4a2f-ac69-90b230c0ee15 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:09.580461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e55183-ab80-4a2f-ac69-90b230c0ee15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:09.594083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:09.643938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-88e55183-ab80-4a2f-ac69-90b230c0ee15 None None] MFA Rules not processed for user `d8d88454e9c44195a17688ed16347e18`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:09.647127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-88e55183-ab80-4a2f-ac69-90b230c0ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:09.869278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 904/1792] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:09 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:09.882625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:09.885125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:09.934613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e55183-ab80-4a2f-ac69-90b230c0ee15 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:09.940684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-88e55183-ab80-4a2f-ac69-90b230c0ee15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:10.208409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68622c1f-b85a-4676-9456-e1547c6a7530 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:10.243793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:10.249691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:10.255135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:10.256267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:10.285385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e55183-ab80-4a2f-ac69-90b230c0ee15 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:10.301327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b4edf1-3c9f-4225-b920-28514192a607 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:10.308111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4edf1-3c9f-4225-b920-28514192a607 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:10.308111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4edf1-3c9f-4225-b920-28514192a607 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:10.308111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b4edf1-3c9f-4225-b920-28514192a607 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:10.329142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:10.341081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:10.399795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 889/1793] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:09 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 518 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:10.400766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:10.408938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:10.620904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4edf1-3c9f-4225-b920-28514192a607 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:10.625660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b4edf1-3c9f-4225-b920-28514192a607 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:10.673067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 905/1794] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 739 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:10.834781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5948a2d2-d259-4152-8693-ee24a86926cc service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:10.860667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:10.861552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:10.861840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:10.862019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] PATH_INFO: `/v3/projects/b757ca53551643b0aad2e5b9e687e4c3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:10.870550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b757ca53551643b0aad2e5b9e687e4c3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:10.878496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:11.040241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b757ca53551643b0aad2e5b9e687e4c3', 'request_id': 'req-486b77b7-af6f-4f5a-89eb-240af4c0af46'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.043037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:11.071376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b757ca53551643b0aad2e5b9e687e4c3', 'request_id': 'req-486b77b7-af6f-4f5a-89eb-240af4c0af46'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.094338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b757ca53551643b0aad2e5b9e687e4c3', 'request_id': 'req-486b77b7-af6f-4f5a-89eb-240af4c0af46'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.136605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] The token cache is being invalidate because project b757ca53551643b0aad2e5b9e687e4c3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:11.140307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.144346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.150060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 890/1795] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:10 2022] DELETE /identity/v3/projects/b757ca53551643b0aad2e5b9e687e4c3 => generated 0 bytes in 750 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:11.157773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aee50-452f-4fff-97dc-a8fcc6724456 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:11.158052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aee50-452f-4fff-97dc-a8fcc6724456 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:11.161031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1aee50-452f-4fff-97dc-a8fcc6724456 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:11.199759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ca1aee50-452f-4fff-97dc-a8fcc6724456 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:11.201334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ca1aee50-452f-4fff-97dc-a8fcc6724456 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:11.338001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:11.339579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:11.353182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:11.435828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 906/1796] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 279 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:11.444026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a85fe-9c48-42dc-839f-b31d35b06523 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:11.446290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a85fe-9c48-42dc-839f-b31d35b06523 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:11.458132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8a85fe-9c48-42dc-839f-b31d35b06523 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:11.510833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fc8a85fe-9c48-42dc-839f-b31d35b06523 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:11.513250 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fc8a85fe-9c48-42dc-839f-b31d35b06523 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:11.515961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486b77b7-af6f-4f5a-89eb-240af4c0af46 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:11.525884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:11.526037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 907/1797] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:11.526151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:11.526151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:11.526151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] PATH_INFO: `/v3/users/db433d707bc74024bee736a29308760a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:11.526151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] RBAC: Authorizing `identity:delete_user(user_id=db433d707bc74024bee736a29308760a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:11.527837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a85fe-9c48-42dc-839f-b31d35b06523 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:11.530029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:11.541791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc8a85fe-9c48-42dc-839f-b31d35b06523 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:11.550056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:11.551018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:11.551456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:11.551936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:11.553649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:11.554691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:11.557513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:11.582506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 908/1798] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:11.589433 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:11.627667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3abe1846-54d3-4d99-9ae7-bc19a08967d6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:11.646231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:11.650263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:11.650554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:11.650840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:11.652263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'db433d707bc74024bee736a29308760a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.654305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:11.660845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:11.688993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'db433d707bc74024bee736a29308760a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.705385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'db433d707bc74024bee736a29308760a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.719753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'db433d707bc74024bee736a29308760a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.722599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fbd34533-4f83-4aaf-825c-d30e14ef752f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'db433d707bc74024bee736a29308760a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:11.734188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 909/1799] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:11 2022] POST /identity/v3/projects => generated 409 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:11.736807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:11.744566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:11.755529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 891/1800] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:11 2022] DELETE /identity/v3/users/db433d707bc74024bee736a29308760a => generated 0 bytes in 415 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:11.758618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f33660-13d6-47b2-94d3-9fe5a4c4ec5c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:11.759611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f33660-13d6-47b2-94d3-9fe5a4c4ec5c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:11.759611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f33660-13d6-47b2-94d3-9fe5a4c4ec5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:11.800832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b5f33660-13d6-47b2-94d3-9fe5a4c4ec5c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:11.804751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b5f33660-13d6-47b2-94d3-9fe5a4c4ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:11.919945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ea81cd-c077-4997-9816-7528f2299b2d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:11.942132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:11.981990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 892/1801] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:12.032100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f33660-13d6-47b2-94d3-9fe5a4c4ec5c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:12.056857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b5f33660-13d6-47b2-94d3-9fe5a4c4ec5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:12.086319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a51c4-bf5e-440f-b663-d08c415e574a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:12.087017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a51c4-bf5e-440f-b663-d08c415e574a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:12.087436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a51c4-bf5e-440f-b663-d08c415e574a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:12.087696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99a51c4-bf5e-440f-b663-d08c415e574a admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:12.088511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a51c4-bf5e-440f-b663-d08c415e574a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:12.101183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99a51c4-bf5e-440f-b663-d08c415e574a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:12.147710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 910/1802] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:11 2022] POST /identity/v3/users => generated 305 bytes in 408 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:12.149892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a51c4-bf5e-440f-b663-d08c415e574a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:12.182481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99a51c4-bf5e-440f-b663-d08c415e574a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:12.190668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e05da-7789-4b98-bb8e-ff065bbc8e83 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:12.191613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e05da-7789-4b98-bb8e-ff065bbc8e83 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:12.192052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e05da-7789-4b98-bb8e-ff065bbc8e83 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:12.192559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7e05da-7789-4b98-bb8e-ff065bbc8e83 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:12.194162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e05da-7789-4b98-bb8e-ff065bbc8e83 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:12.196044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7e05da-7789-4b98-bb8e-ff065bbc8e83 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:12.211677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 911/1803] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:12.217361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e05da-7789-4b98-bb8e-ff065bbc8e83 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:12.245409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7e05da-7789-4b98-bb8e-ff065bbc8e83 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:12.258833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51159358-9254-449e-afb2-99adef8c9488 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:12.260071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51159358-9254-449e-afb2-99adef8c9488 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:12.261088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51159358-9254-449e-afb2-99adef8c9488 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:12.261562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51159358-9254-449e-afb2-99adef8c9488 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:12.263029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51159358-9254-449e-afb2-99adef8c9488 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:12.268145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51159358-9254-449e-afb2-99adef8c9488 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:12.308745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 912/1804] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:12 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:12.310472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51159358-9254-449e-afb2-99adef8c9488 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:12.330578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51159358-9254-449e-afb2-99adef8c9488 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:12.349160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d97b3c-b29d-47ab-a1f8-8abfe3962d5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:12.350687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d97b3c-b29d-47ab-a1f8-8abfe3962d5c admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:12.351038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d97b3c-b29d-47ab-a1f8-8abfe3962d5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:12.351320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d97b3c-b29d-47ab-a1f8-8abfe3962d5c admin admin] PATH_INFO: `/v3/projects/f56ca2791df048c8b0ff5f193a21243f/users/30ac040de1774a3a956818dbd52a23f8/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:12.356277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5f33660-13d6-47b2-94d3-9fe5a4c4ec5c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:12.379353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0fa8ca-9fd5-471c-9ad2-f0832db9b99b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:12.380273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa8ca-9fd5-471c-9ad2-f0832db9b99b service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:12.381789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa8ca-9fd5-471c-9ad2-f0832db9b99b service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:12.382866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0fa8ca-9fd5-471c-9ad2-f0832db9b99b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:12.399905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:12.426011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d97b3c-b29d-47ab-a1f8-8abfe3962d5c admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56ca2791df048c8b0ff5f193a21243f, user_id=30ac040de1774a3a956818dbd52a23f8, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:12.435757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60d97b3c-b29d-47ab-a1f8-8abfe3962d5c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:12.440515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fa8ca-9fd5-471c-9ad2-f0832db9b99b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:12.442093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0fa8ca-9fd5-471c-9ad2-f0832db9b99b service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:12.486275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 913/1805] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:12 2022] PUT /identity/v3/projects/f56ca2791df048c8b0ff5f193a21243f/users/30ac040de1774a3a956818dbd52a23f8/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:12.486275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8545d-9743-4a5d-9f6c-e0c82c0a970e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:12.486275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8545d-9743-4a5d-9f6c-e0c82c0a970e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:12.486275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2f8545d-9743-4a5d-9f6c-e0c82c0a970e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:12.509163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 893/1806] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 481 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:12.511178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516287ba-6cb5-49a1-b0da-b0788eea3d27 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:12.511705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516287ba-6cb5-49a1-b0da-b0788eea3d27 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:12.512227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-516287ba-6cb5-49a1-b0da-b0788eea3d27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:12.538344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f2f8545d-9743-4a5d-9f6c-e0c82c0a970e None None] MFA Rules not processed for user `686a32aea0b945d9a76875110c8f84ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:12.539413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f2f8545d-9743-4a5d-9f6c-e0c82c0a970e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:12.609036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-516287ba-6cb5-49a1-b0da-b0788eea3d27 None None] MFA Rules not processed for user `30ac040de1774a3a956818dbd52a23f8`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:12.610666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-516287ba-6cb5-49a1-b0da-b0788eea3d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:12.774637 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 914/1807] 10.222.0.25 () {58 vars in 1015 bytes} [Tue Jul 12 08:37:12 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:12.845091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 894/1808] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:12 2022] POST /identity/v3/auth/tokens => generated 3276 bytes in 335 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:12.845771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8545d-9743-4a5d-9f6c-e0c82c0a970e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:12.904566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516287ba-6cb5-49a1-b0da-b0788eea3d27 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:12.906510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-516287ba-6cb5-49a1-b0da-b0788eea3d27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:12.928848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-516287ba-6cb5-49a1-b0da-b0788eea3d27 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:12.978072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c416-84da-456b-9563-0a7ae63e54be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:12.978072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c416-84da-456b-9563-0a7ae63e54be service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:12.978072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c416-84da-456b-9563-0a7ae63e54be service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:12.978072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c83c416-84da-456b-9563-0a7ae63e54be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:13.004957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83c416-84da-456b-9563-0a7ae63e54be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:13.007288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c83c416-84da-456b-9563-0a7ae63e54be service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:13.039842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 895/1809] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:12 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:13.147928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2f8545d-9743-4a5d-9f6c-e0c82c0a970e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:13.159064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730d22e-54c3-45e2-83c0-c64f1fa7f5ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:13.160029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730d22e-54c3-45e2-83c0-c64f1fa7f5ef admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:13.160419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730d22e-54c3-45e2-83c0-c64f1fa7f5ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:13.160819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2730d22e-54c3-45e2-83c0-c64f1fa7f5ef admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:13.162556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730d22e-54c3-45e2-83c0-c64f1fa7f5ef admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:13.173269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2730d22e-54c3-45e2-83c0-c64f1fa7f5ef admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:13.238050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 915/1810] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:12 2022] POST /identity/v3/projects => generated 409 bytes in 393 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:13.238638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c416-84da-456b-9563-0a7ae63e54be service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:13.271613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c83c416-84da-456b-9563-0a7ae63e54be service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:13.453876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3050-a42f-4f85-814e-781055805286 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:13.457746 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3050-a42f-4f85-814e-781055805286 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:13.462680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3050-a42f-4f85-814e-781055805286 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:13.463860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fe3050-a42f-4f85-814e-781055805286 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:13.468163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3050-a42f-4f85-814e-781055805286 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:13.495102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fe3050-a42f-4f85-814e-781055805286 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:13.582007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 896/1811] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:13 2022] POST /identity/v3/users => generated 311 bytes in 346 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:13.587871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730d22e-54c3-45e2-83c0-c64f1fa7f5ef admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:13.612987 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2730d22e-54c3-45e2-83c0-c64f1fa7f5ef admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:13.622417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222014b-e0d6-46ef-815f-7a32a3f453dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:13.623466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222014b-e0d6-46ef-815f-7a32a3f453dc admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:13.624034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222014b-e0d6-46ef-815f-7a32a3f453dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:13.624333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a222014b-e0d6-46ef-815f-7a32a3f453dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:13.625102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222014b-e0d6-46ef-815f-7a32a3f453dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:13.626860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a222014b-e0d6-46ef-815f-7a32a3f453dc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:13.729898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 916/1812] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:13.732836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3050-a42f-4f85-814e-781055805286 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:13.750959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fe3050-a42f-4f85-814e-781055805286 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:13.762422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e6e7f-5282-4aa4-b0bf-9029c4358047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:13.763329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6e7f-5282-4aa4-b0bf-9029c4358047 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:13.764940 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6e7f-5282-4aa4-b0bf-9029c4358047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:13.766369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9e6e7f-5282-4aa4-b0bf-9029c4358047 admin admin] PATH_INFO: `/v3/projects/61ba3cf52dff43f8a12539579b2d5755/users/3545b631e01b4cdb9fd6d6f2d9525ad1/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:13.775956 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:13.809797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e6e7f-5282-4aa4-b0bf-9029c4358047 admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ba3cf52dff43f8a12539579b2d5755, user_id=3545b631e01b4cdb9fd6d6f2d9525ad1, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:13.814993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9e6e7f-5282-4aa4-b0bf-9029c4358047 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:13.847725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 897/1813] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:13 2022] PUT /identity/v3/projects/61ba3cf52dff43f8a12539579b2d5755/users/3545b631e01b4cdb9fd6d6f2d9525ad1/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:13.852720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222014b-e0d6-46ef-815f-7a32a3f453dc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:13.907082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a222014b-e0d6-46ef-815f-7a32a3f453dc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:14.126260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370ce6e9-84e8-4ae0-8b40-f4ee7c5ee470 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:14.127124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ce6e9-84e8-4ae0-8b40-f4ee7c5ee470 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:14.127403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ce6e9-84e8-4ae0-8b40-f4ee7c5ee470 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:14.127680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370ce6e9-84e8-4ae0-8b40-f4ee7c5ee470 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:14.128416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ce6e9-84e8-4ae0-8b40-f4ee7c5ee470 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:14.130379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370ce6e9-84e8-4ae0-8b40-f4ee7c5ee470 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:14.177089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e6e7f-5282-4aa4-b0bf-9029c4358047 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:14.182902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 917/1814] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:13 2022] GET /identity/v3/roles => generated 1420 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:14.209693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9e6e7f-5282-4aa4-b0bf-9029c4358047 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:14.236998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:14.238004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:14.238357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:14.238749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] PATH_INFO: `/v3/projects/61ba3cf52dff43f8a12539579b2d5755/users/3545b631e01b4cdb9fd6d6f2d9525ad1/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:14.242966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] RBAC: Authorizing `identity:create_grant(project_id=61ba3cf52dff43f8a12539579b2d5755, user_id=3545b631e01b4cdb9fd6d6f2d9525ad1, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:14.246535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:14.328951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 898/1815] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:14 2022] PUT /identity/v3/projects/61ba3cf52dff43f8a12539579b2d5755/users/3545b631e01b4cdb9fd6d6f2d9525ad1/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:14.336042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde6d0-8c86-4179-b39b-7d03cfd8bfaa None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:14.336634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde6d0-8c86-4179-b39b-7d03cfd8bfaa None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:14.337277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bde6d0-8c86-4179-b39b-7d03cfd8bfaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:14.400204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:14.452825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-30bde6d0-8c86-4179-b39b-7d03cfd8bfaa None None] MFA Rules not processed for user `3545b631e01b4cdb9fd6d6f2d9525ad1`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:14.454810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-30bde6d0-8c86-4179-b39b-7d03cfd8bfaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:14.664428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 918/1816] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:14 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 330 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:14.674642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:14.676463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:14.915391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c02101-382d-4866-8e33-8110efd1872e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:14.930814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:14.931726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:14.932305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:14.932650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:14.946908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:14.949813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:15.008578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 899/1817] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:14 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 334 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:15.444236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde6d0-8c86-4179-b39b-7d03cfd8bfaa None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:15.464600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bde6d0-8c86-4179-b39b-7d03cfd8bfaa None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:15.479532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff0c3-8b41-420f-a3b6-17e33836e360 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:15.480583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff0c3-8b41-420f-a3b6-17e33836e360 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:15.481087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff0c3-8b41-420f-a3b6-17e33836e360 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:15.481592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99bff0c3-8b41-420f-a3b6-17e33836e360 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:15.535671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:15.538554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:15.641112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff0c3-8b41-420f-a3b6-17e33836e360 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:15.645533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99bff0c3-8b41-420f-a3b6-17e33836e360 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:15.676287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 919/1818] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:15 2022] GET /identity/v3/auth/tokens => generated 3276 bytes in 233 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:15.740450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eb5913b-504b-42d0-b909-0fd56f93b5dc service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:15.748510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:15.749923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:15.750459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:15.751551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] PATH_INFO: `/v3/projects/b1ce3543c9f54f0381fc737e0a419aee` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:15.753147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] RBAC: Authorizing `identity:delete_project(project_id=b1ce3543c9f54f0381fc737e0a419aee)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:15.756269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:15.905387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b1ce3543c9f54f0381fc737e0a419aee', 'request_id': 'req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:15.917396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b1ce3543c9f54f0381fc737e0a419aee', 'request_id': 'req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:15.939984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b1ce3543c9f54f0381fc737e0a419aee', 'request_id': 'req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:15.965134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] The token cache is being invalidate because project b1ce3543c9f54f0381fc737e0a419aee was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:15.965770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:15.966458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:15.972444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 900/1819] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:15 2022] DELETE /identity/v3/projects/b1ce3543c9f54f0381fc737e0a419aee => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:15.977365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff0c3-8b41-420f-a3b6-17e33836e360 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:15.995067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99bff0c3-8b41-420f-a3b6-17e33836e360 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:16.129129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:16.130035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:16.138610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:16.168639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:16.173287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:16.174840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:16.175411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] PATH_INFO: `/v3/users/1848ce412e334ba9920646cff5ead9b8` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:16.179529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1848ce412e334ba9920646cff5ead9b8)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:16.201575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:16.297389 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:16.328336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1848ce412e334ba9920646cff5ead9b8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.344964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1848ce412e334ba9920646cff5ead9b8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.361621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-783da6b9-e13c-4a9b-9c68-dc06ead7e89b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:16.364232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1848ce412e334ba9920646cff5ead9b8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.391052 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:16.392940 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:16.394220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:16.394608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] PATH_INFO: `/v3/projects/4b8c6b8e2b6d47338ee7cc1dc3def6a4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:16.398400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4b8c6b8e2b6d47338ee7cc1dc3def6a4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:16.402171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:16.418829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1848ce412e334ba9920646cff5ead9b8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.420884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1848ce412e334ba9920646cff5ead9b8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.454574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 920/1820] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:15 2022] DELETE /identity/v3/users/1848ce412e334ba9920646cff5ead9b8 => generated 0 bytes in 474 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:16.545134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4b8c6b8e2b6d47338ee7cc1dc3def6a4', 'request_id': 'req-e8b9186d-944a-4d96-acac-7136ecc65af8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.561207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4b8c6b8e2b6d47338ee7cc1dc3def6a4', 'request_id': 'req-e8b9186d-944a-4d96-acac-7136ecc65af8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.584154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4b8c6b8e2b6d47338ee7cc1dc3def6a4', 'request_id': 'req-e8b9186d-944a-4d96-acac-7136ecc65af8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.638944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] The token cache is being invalidate because project 4b8c6b8e2b6d47338ee7cc1dc3def6a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:16.639235 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.644764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e8b9186d-944a-4d96-acac-7136ecc65af8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:16.648101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 901/1821] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:16 2022] DELETE /identity/v3/projects/4b8c6b8e2b6d47338ee7cc1dc3def6a4 => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:16.652098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:16.653992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:16.894656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84e3da-cd18-47a2-9178-2b65df2ac235 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:17.104154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:17.105573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:17.105573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:17.105767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] PATH_INFO: `/v3/users/d8d88454e9c44195a17688ed16347e18` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:17.106935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d8d88454e9c44195a17688ed16347e18)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:17.109050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:17.264996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd8d88454e9c44195a17688ed16347e18'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:17.284418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd8d88454e9c44195a17688ed16347e18'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:17.291178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:17.305921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd8d88454e9c44195a17688ed16347e18'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:17.339042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd8d88454e9c44195a17688ed16347e18'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:17.339849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0562741b-7e64-4f42-8a30-0fad36dc2b81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd8d88454e9c44195a17688ed16347e18'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:17.347377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 921/1822] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:16 2022] DELETE /identity/v3/users/d8d88454e9c44195a17688ed16347e18 => generated 0 bytes in 696 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:19.959482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842a2b-cacd-4786-8dad-31af7e6b3efb None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:19.960013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842a2b-cacd-4786-8dad-31af7e6b3efb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:19.960334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1842a2b-cacd-4786-8dad-31af7e6b3efb None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:19.961872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 902/1823] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:37:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:37:20.127078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60cf0-0c57-47ac-a06c-b9fb0cd769a1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:20.127585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60cf0-0c57-47ac-a06c-b9fb0cd769a1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:20.127824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e60cf0-0c57-47ac-a06c-b9fb0cd769a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:20.153610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-84e60cf0-0c57-47ac-a06c-b9fb0cd769a1 None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:20.156057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-84e60cf0-0c57-47ac-a06c-b9fb0cd769a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:20.312296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842a2b-cacd-4786-8dad-31af7e6b3efb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:20.314843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a1842a2b-cacd-4786-8dad-31af7e6b3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:20.327979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 922/1824] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:37:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:20.460779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1842a2b-cacd-4786-8dad-31af7e6b3efb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:20.462617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f696-d7a7-44ec-bc1b-071faff16b90 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:20.462911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f696-d7a7-44ec-bc1b-071faff16b90 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:20.463185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f0f696-d7a7-44ec-bc1b-071faff16b90 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:20.464726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 923/1825] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:37:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:37:20.471497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:20.472407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:20.472679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:20.472950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] PATH_INFO: `/v3/projects/b7d14e8c4d96413f83ffa4398923127c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:20.475558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b7d14e8c4d96413f83ffa4398923127c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:20.480269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26a47f-d94a-4cee-9764-c4fd68742998 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:20.480559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26a47f-d94a-4cee-9764-c4fd68742998 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:20.480844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a26a47f-d94a-4cee-9764-c4fd68742998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:20.487596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:20.506492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6a26a47f-d94a-4cee-9764-c4fd68742998 None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:20.507726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6a26a47f-d94a-4cee-9764-c4fd68742998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:20.557181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 924/1826] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:37:20 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:20.576534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:20.600515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b7d14e8c4d96413f83ffa4398923127c', 'request_id': 'req-52921fe6-054e-426b-9b51-c665be0dadca'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:20.616150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b7d14e8c4d96413f83ffa4398923127c', 'request_id': 'req-52921fe6-054e-426b-9b51-c665be0dadca'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:20.627722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b7d14e8c4d96413f83ffa4398923127c', 'request_id': 'req-52921fe6-054e-426b-9b51-c665be0dadca'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:20.643119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] The token cache is being invalidate because project b7d14e8c4d96413f83ffa4398923127c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:20.643777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:20.644652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:20.648050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 903/1827] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:20 2022] DELETE /identity/v3/projects/b7d14e8c4d96413f83ffa4398923127c => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:20.654194 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282a28e-00ae-4c3f-b75a-0d25434c92b4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:20.654764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282a28e-00ae-4c3f-b75a-0d25434c92b4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:20.655220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282a28e-00ae-4c3f-b75a-0d25434c92b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:20.693957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8282a28e-00ae-4c3f-b75a-0d25434c92b4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:20.697365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8282a28e-00ae-4c3f-b75a-0d25434c92b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:20.751116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:20.753019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:20.857539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 925/1828] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:20.880884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042df2-a0b3-43a9-8184-2f46e5ce2398 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:20.885695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042df2-a0b3-43a9-8184-2f46e5ce2398 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:20.886082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3042df2-a0b3-43a9-8184-2f46e5ce2398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:20.904864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52921fe6-054e-426b-9b51-c665be0dadca admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:20.922165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:20.922945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:20.923227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:20.923837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] PATH_INFO: `/v3/projects/7727e104c7f248e7964d2da0e1e2de66` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:20.923965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b3042df2-a0b3-43a9-8184-2f46e5ce2398 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:20.925198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b3042df2-a0b3-43a9-8184-2f46e5ce2398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:20.925620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] RBAC: Authorizing `identity:delete_project(project_id=7727e104c7f248e7964d2da0e1e2de66)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:20.928990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:20.944078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 926/1829] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:20.945024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3042df2-a0b3-43a9-8184-2f46e5ce2398 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:20.947033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b3042df2-a0b3-43a9-8184-2f46e5ce2398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:21.018033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:21.039118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7727e104c7f248e7964d2da0e1e2de66', 'request_id': 'req-d41ad999-7ca6-4b3e-96c7-f508106aa45f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:21.051633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7727e104c7f248e7964d2da0e1e2de66', 'request_id': 'req-d41ad999-7ca6-4b3e-96c7-f508106aa45f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:21.055491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3042df2-a0b3-43a9-8184-2f46e5ce2398 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:21.060559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7727e104c7f248e7964d2da0e1e2de66', 'request_id': 'req-d41ad999-7ca6-4b3e-96c7-f508106aa45f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:21.073095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] The token cache is being invalidate because project 7727e104c7f248e7964d2da0e1e2de66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:21.074211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:21.075041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:21.077290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 904/1830] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:20 2022] DELETE /identity/v3/projects/7727e104c7f248e7964d2da0e1e2de66 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:21.078249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:21.081079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:21.181068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:21.201505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d41ad999-7ca6-4b3e-96c7-f508106aa45f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:21.209490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:21.210753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.211306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.211866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.213502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:21.213819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:21.216013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:21.235671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 905/1831] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:21.236715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:21.238543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:21.277187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15ada7a-4d3c-49b0-ae44-e6ff4d96676b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:21.277858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ada7a-4d3c-49b0-ae44-e6ff4d96676b service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.278556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ada7a-4d3c-49b0-ae44-e6ff4d96676b service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.279698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15ada7a-4d3c-49b0-ae44-e6ff4d96676b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.283044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d15ada7a-4d3c-49b0-ae44-e6ff4d96676b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:21.340184 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ada7a-4d3c-49b0-ae44-e6ff4d96676b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:21.342292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15ada7a-4d3c-49b0-ae44-e6ff4d96676b service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:21.389830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856f002e-5b71-4215-875b-7c5fa499c8d4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:21.390498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 927/1832] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:20 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:21.394917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064668-ad46-4136-9269-3138dd8cefe4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.395207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064668-ad46-4136-9269-3138dd8cefe4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.395503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d064668-ad46-4136-9269-3138dd8cefe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.411186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:21.412581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.412915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.413190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.418654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:21.449148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:21.457244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:21.475852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-6d064668-ad46-4136-9269-3138dd8cefe4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:21.478832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6d064668-ad46-4136-9269-3138dd8cefe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:21.504781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 906/1833] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:21 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 268 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:21.507983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:21.529748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 928/1834] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:21.532171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96043875-0a76-4587-99fc-098d2a75150e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.536314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96043875-0a76-4587-99fc-098d2a75150e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.537804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96043875-0a76-4587-99fc-098d2a75150e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.540494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d74b23-a8ef-45fa-aa80-105d7e0ff1ed service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:21.559444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dbdf5-613a-475f-8f1f-97962dcfda57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:21.560655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbdf5-613a-475f-8f1f-97962dcfda57 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.561115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbdf5-613a-475f-8f1f-97962dcfda57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.561603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52dbdf5-613a-475f-8f1f-97962dcfda57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.562468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dbdf5-613a-475f-8f1f-97962dcfda57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:21.569212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d52dbdf5-613a-475f-8f1f-97962dcfda57 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:21.620604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-96043875-0a76-4587-99fc-098d2a75150e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:21.623994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-96043875-0a76-4587-99fc-098d2a75150e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:21.631289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 907/1835] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:21 2022] POST /identity/v3/projects => generated 369 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:21.640750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dbdf5-613a-475f-8f1f-97962dcfda57 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:21.658549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 929/1836] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:21.664676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96043875-0a76-4587-99fc-098d2a75150e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:21.702462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96043875-0a76-4587-99fc-098d2a75150e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:21.810776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52dbdf5-613a-475f-8f1f-97962dcfda57 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:21.820152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b13b8-487b-4b1c-99ae-c76de8e10886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:21.820837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b13b8-487b-4b1c-99ae-c76de8e10886 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.821127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b13b8-487b-4b1c-99ae-c76de8e10886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.821402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731b13b8-487b-4b1c-99ae-c76de8e10886 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.822993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b13b8-487b-4b1c-99ae-c76de8e10886 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:21.826764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731b13b8-487b-4b1c-99ae-c76de8e10886 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:21.854505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:21.855747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.857200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.857668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.858537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:21.858951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:21.861463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:21.869079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 908/1837] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:21 2022] POST /identity/v3/users => generated 285 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:21.873152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b13b8-487b-4b1c-99ae-c76de8e10886 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:21.895812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731b13b8-487b-4b1c-99ae-c76de8e10886 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:21.904692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 930/1838] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:21.909565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:21.910841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f860-292f-40e2-afb7-8218198947aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:21.928828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f860-292f-40e2-afb7-8218198947aa admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.928828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f860-292f-40e2-afb7-8218198947aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.929142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12d7f860-292f-40e2-afb7-8218198947aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.935072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7f860-292f-40e2-afb7-8218198947aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:21.939588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12d7f860-292f-40e2-afb7-8218198947aa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:21.959696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e86da4d-4beb-4c8a-bd3f-955c32e280a8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:21.964267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 909/1839] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:21.969089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f860-292f-40e2-afb7-8218198947aa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:21.981135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598217d7-9d6e-4ce3-9b70-f38b15b41289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:21.981834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598217d7-9d6e-4ce3-9b70-f38b15b41289 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:21.982113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598217d7-9d6e-4ce3-9b70-f38b15b41289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:21.982384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598217d7-9d6e-4ce3-9b70-f38b15b41289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:21.983077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598217d7-9d6e-4ce3-9b70-f38b15b41289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:21.984988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598217d7-9d6e-4ce3-9b70-f38b15b41289 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:21.995662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12d7f860-292f-40e2-afb7-8218198947aa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.012177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2e5cc-f829-44ec-9a22-3a612125586a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:22.012870 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2e5cc-f829-44ec-9a22-3a612125586a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.013166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2e5cc-f829-44ec-9a22-3a612125586a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.013454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf2e5cc-f829-44ec-9a22-3a612125586a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.014193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2e5cc-f829-44ec-9a22-3a612125586a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:22.018665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf2e5cc-f829-44ec-9a22-3a612125586a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:22.054353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 910/1840] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:21 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:22.055561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2e5cc-f829-44ec-9a22-3a612125586a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:22.057754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 931/1841] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:21 2022] POST /identity/v3/projects => generated 377 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:22.061646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598217d7-9d6e-4ce3-9b70-f38b15b41289 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:22.084032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf2e5cc-f829-44ec-9a22-3a612125586a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.129803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:22.201738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:22.230226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b60183e-3ab2-4f65-a339-282e27dad937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:22.231142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60183e-3ab2-4f65-a339-282e27dad937 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.231430 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60183e-3ab2-4f65-a339-282e27dad937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.231710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b60183e-3ab2-4f65-a339-282e27dad937 admin admin] PATH_INFO: `/v3/projects/d6738716b69f46ef8b82f94cdf58aade/users/0049d90b851d40d5b39b22416504cc5b/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.262768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598217d7-9d6e-4ce3-9b70-f38b15b41289 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.264857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60183e-3ab2-4f65-a339-282e27dad937 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d6738716b69f46ef8b82f94cdf58aade, user_id=0049d90b851d40d5b39b22416504cc5b, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:22.267691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b60183e-3ab2-4f65-a339-282e27dad937 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:22.269731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9407a4-8603-400b-bcde-574f9307578c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:22.270672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9407a4-8603-400b-bcde-574f9307578c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.271412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9407a4-8603-400b-bcde-574f9307578c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.272423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9407a4-8603-400b-bcde-574f9307578c admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.273922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9407a4-8603-400b-bcde-574f9307578c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:22.292930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9407a4-8603-400b-bcde-574f9307578c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:22.307000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 911/1842] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:22 2022] PUT /identity/v3/projects/d6738716b69f46ef8b82f94cdf58aade/users/0049d90b851d40d5b39b22416504cc5b/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:22.315099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418d7a-a4bb-4c34-957d-b956e0c729ab None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.315661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418d7a-a4bb-4c34-957d-b956e0c729ab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.317007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb418d7a-a4bb-4c34-957d-b956e0c729ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.383480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bb418d7a-a4bb-4c34-957d-b956e0c729ab None None] MFA Rules not processed for user `0049d90b851d40d5b39b22416504cc5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:22.385386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bb418d7a-a4bb-4c34-957d-b956e0c729ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:22.402463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 932/1843] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:22 2022] POST /identity/v3/users => generated 289 bytes in 341 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:22.404392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9407a4-8603-400b-bcde-574f9307578c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:22.444384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9407a4-8603-400b-bcde-574f9307578c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.503689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 912/1844] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:22 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:22.505257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418d7a-a4bb-4c34-957d-b956e0c729ab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:22.566843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea436e9-1c55-486d-b79a-88285b79d342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:22.568059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea436e9-1c55-486d-b79a-88285b79d342 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.568059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea436e9-1c55-486d-b79a-88285b79d342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.568370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea436e9-1c55-486d-b79a-88285b79d342 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.569163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea436e9-1c55-486d-b79a-88285b79d342 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:22.571692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea436e9-1c55-486d-b79a-88285b79d342 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:22.587249 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 933/1845] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:22.590056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb418d7a-a4bb-4c34-957d-b956e0c729ab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.591500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea436e9-1c55-486d-b79a-88285b79d342 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:22.600810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330a87e-f5f9-40f6-a8dd-83c121bed342 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:22.601508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330a87e-f5f9-40f6-a8dd-83c121bed342 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.601791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330a87e-f5f9-40f6-a8dd-83c121bed342 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.602063 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330a87e-f5f9-40f6-a8dd-83c121bed342 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.602759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330a87e-f5f9-40f6-a8dd-83c121bed342 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:22.604741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330a87e-f5f9-40f6-a8dd-83c121bed342 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:22.611199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea436e9-1c55-486d-b79a-88285b79d342 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.623488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abaf4a-cc67-4a7b-abd4-9fa05a299633 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:22.623488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abaf4a-cc67-4a7b-abd4-9fa05a299633 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.623488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abaf4a-cc67-4a7b-abd4-9fa05a299633 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.623488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69abaf4a-cc67-4a7b-abd4-9fa05a299633 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.623791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abaf4a-cc67-4a7b-abd4-9fa05a299633 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:22.630525 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69abaf4a-cc67-4a7b-abd4-9fa05a299633 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:22.642024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 913/1846] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:22 2022] POST /identity/v3/projects => generated 367 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:22.643407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 934/1847] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:22.646498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330a87e-f5f9-40f6-a8dd-83c121bed342 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:22.649177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abaf4a-cc67-4a7b-abd4-9fa05a299633 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:22.663657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69abaf4a-cc67-4a7b-abd4-9fa05a299633 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.673686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:22.779577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c6b8329-84bb-4738-8b47-629234ed8a67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:22.780698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8329-84bb-4738-8b47-629234ed8a67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.782245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8329-84bb-4738-8b47-629234ed8a67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.783717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c6b8329-84bb-4738-8b47-629234ed8a67 admin admin] PATH_INFO: `/v3/projects/9c2b9d104e624bc28e635e311f7d35f5/users/eb290264879942a099605d8ebc6a361a/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.804898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330a87e-f5f9-40f6-a8dd-83c121bed342 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.825825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8329-84bb-4738-8b47-629234ed8a67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9c2b9d104e624bc28e635e311f7d35f5, user_id=eb290264879942a099605d8ebc6a361a, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:22.835053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e6c77-e6f1-4f36-b787-0fac9e88d91d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:22.835330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e6c77-e6f1-4f36-b787-0fac9e88d91d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.835621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e6c77-e6f1-4f36-b787-0fac9e88d91d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.835903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401e6c77-e6f1-4f36-b787-0fac9e88d91d admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.836625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e6c77-e6f1-4f36-b787-0fac9e88d91d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:22.837581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c6b8329-84bb-4738-8b47-629234ed8a67 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:22.843352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401e6c77-e6f1-4f36-b787-0fac9e88d91d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:22.877099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 935/1848] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:22 2022] PUT /identity/v3/projects/9c2b9d104e624bc28e635e311f7d35f5/users/eb290264879942a099605d8ebc6a361a/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:22.887751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601fb7-3c08-4810-b709-f419170cf8b2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:22.888447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601fb7-3c08-4810-b709-f419170cf8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:22.888960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4601fb7-3c08-4810-b709-f419170cf8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:22.922296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 914/1849] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:22 2022] POST /identity/v3/users => generated 290 bytes in 277 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:37:22.924428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e6c77-e6f1-4f36-b787-0fac9e88d91d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:22.936669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f4601fb7-3c08-4810-b709-f419170cf8b2 None None] MFA Rules not processed for user `eb290264879942a099605d8ebc6a361a`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:22.938336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f4601fb7-3c08-4810-b709-f419170cf8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:22.939393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401e6c77-e6f1-4f36-b787-0fac9e88d91d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:22.978539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:23.048803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 936/1850] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:22 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:23.056660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4601fb7-3c08-4810-b709-f419170cf8b2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:23.060577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f4601fb7-3c08-4810-b709-f419170cf8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:23.107254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ed61-a09d-4ea6-907d-839b17160492 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:23.110006 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ed61-a09d-4ea6-907d-839b17160492 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:23.110371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ed61-a09d-4ea6-907d-839b17160492 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:23.111272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0212ed61-a09d-4ea6-907d-839b17160492 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:23.114325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ed61-a09d-4ea6-907d-839b17160492 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:23.117224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0212ed61-a09d-4ea6-907d-839b17160492 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:23.149255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 915/1851] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:22 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:23.150411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ed61-a09d-4ea6-907d-839b17160492 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:23.173989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0212ed61-a09d-4ea6-907d-839b17160492 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:23.191323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb50ae9-6482-4c7a-907f-645e5461c89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:23.194812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50ae9-6482-4c7a-907f-645e5461c89e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:23.195193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50ae9-6482-4c7a-907f-645e5461c89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:23.196098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb50ae9-6482-4c7a-907f-645e5461c89e admin admin] PATH_INFO: `/v3/projects/e6751f7456214b209cdbbceb5a49c351/users/9265025a95e745b0a4efc980eeb85e6b/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:23.240517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50ae9-6482-4c7a-907f-645e5461c89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6751f7456214b209cdbbceb5a49c351, user_id=9265025a95e745b0a4efc980eeb85e6b, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:23.247373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb50ae9-6482-4c7a-907f-645e5461c89e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:23.280814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 916/1852] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:23 2022] PUT /identity/v3/projects/e6751f7456214b209cdbbceb5a49c351/users/9265025a95e745b0a4efc980eeb85e6b/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:23.281108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4601fb7-3c08-4810-b709-f419170cf8b2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:23.281505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb50ae9-6482-4c7a-907f-645e5461c89e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:23.444710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb50ae9-6482-4c7a-907f-645e5461c89e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:23.457635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993e107cc04e4ce6b9abd9997c29381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:23.460560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:23.462898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:23.464211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:23.465039 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35471a66-5347-480e-971c-7702c7a8227f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:23.469567 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35471a66-5347-480e-971c-7702c7a8227f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:23.471636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35471a66-5347-480e-971c-7702c7a8227f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:23.473698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35471a66-5347-480e-971c-7702c7a8227f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:23.481042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35471a66-5347-480e-971c-7702c7a8227f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:23.496583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35471a66-5347-480e-971c-7702c7a8227f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:23.548310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 917/1853] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:23 2022] GET /identity/v3/roles => generated 1420 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:23.553156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35471a66-5347-480e-971c-7702c7a8227f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:23.571362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35471a66-5347-480e-971c-7702c7a8227f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:23.582178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769f14ba-20c7-4e29-9108-f60a59461a3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:23.585115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f14ba-20c7-4e29-9108-f60a59461a3e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:23.585544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f14ba-20c7-4e29-9108-f60a59461a3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:23.585927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769f14ba-20c7-4e29-9108-f60a59461a3e admin admin] PATH_INFO: `/v3/projects/e6751f7456214b209cdbbceb5a49c351/users/9265025a95e745b0a4efc980eeb85e6b/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:23.588206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f14ba-20c7-4e29-9108-f60a59461a3e admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6751f7456214b209cdbbceb5a49c351, user_id=9265025a95e745b0a4efc980eeb85e6b, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:23.591172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769f14ba-20c7-4e29-9108-f60a59461a3e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:23.606454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 918/1854] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:23 2022] PUT /identity/v3/projects/e6751f7456214b209cdbbceb5a49c351/users/9265025a95e745b0a4efc980eeb85e6b/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:23.624209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70643-ce9a-4cc8-8480-633494583e18 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:23.624535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70643-ce9a-4cc8-8480-633494583e18 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:23.624822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a70643-ce9a-4cc8-8480-633494583e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:23.634401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:23.683767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-28a70643-ce9a-4cc8-8480-633494583e18 None None] MFA Rules not processed for user `9265025a95e745b0a4efc980eeb85e6b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:23.688101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28a70643-ce9a-4cc8-8480-633494583e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:23.689030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:23.690565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:23.717055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 937/1855] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:23 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 660 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:23.861461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 919/1856] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:23 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:23.874784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:23.876388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:23.908871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:23.970658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387dce73-e80e-4df4-bbf4-c179b3f2a5fc service glance] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:24.072353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89a0d2c-2204-408e-b643-0ae24921f0c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:24.073201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0d2c-2204-408e-b643-0ae24921f0c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:24.073794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0d2c-2204-408e-b643-0ae24921f0c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:24.074226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89a0d2c-2204-408e-b643-0ae24921f0c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:24.088399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a0d2c-2204-408e-b643-0ae24921f0c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:24.090157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89a0d2c-2204-408e-b643-0ae24921f0c2 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:24.116843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 938/1857] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:23 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 242 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:26.006550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70643-ce9a-4cc8-8480-633494583e18 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:26.014269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28a70643-ce9a-4cc8-8480-633494583e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:26.136944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a70643-ce9a-4cc8-8480-633494583e18 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:26.156417 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:26.157442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:26.158338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:26.158635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] PATH_INFO: `/v3/users/30ac040de1774a3a956818dbd52a23f8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:26.160316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] RBAC: Authorizing `identity:delete_user(user_id=30ac040de1774a3a956818dbd52a23f8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:26.162953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:26.236677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30ac040de1774a3a956818dbd52a23f8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.254957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30ac040de1774a3a956818dbd52a23f8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.264180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30ac040de1774a3a956818dbd52a23f8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.286143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30ac040de1774a3a956818dbd52a23f8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.287474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30ac040de1774a3a956818dbd52a23f8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.296981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 920/1858] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:26 2022] DELETE /identity/v3/users/30ac040de1774a3a956818dbd52a23f8 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:26.302500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efc25f-be9f-4acf-ba9d-b33202598530 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:26.302966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efc25f-be9f-4acf-ba9d-b33202598530 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:26.303059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60efc25f-be9f-4acf-ba9d-b33202598530 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:26.322378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-60efc25f-be9f-4acf-ba9d-b33202598530 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:26.323770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-60efc25f-be9f-4acf-ba9d-b33202598530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:26.385723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:26.387607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:26.408147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 939/1859] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:26.415507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efc25f-be9f-4acf-ba9d-b33202598530 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:26.419531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-60efc25f-be9f-4acf-ba9d-b33202598530 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:26.425923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:26.510737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60efc25f-be9f-4acf-ba9d-b33202598530 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:26.510945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1bb6991-3724-4881-bdad-44343120b992 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:26.515892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:26.516255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaea91d1-7262-44dd-ae34-4d5618e307f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:26.516920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea91d1-7262-44dd-ae34-4d5618e307f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:26.517205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea91d1-7262-44dd-ae34-4d5618e307f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:26.517518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaea91d1-7262-44dd-ae34-4d5618e307f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:26.517633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:26.518147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:26.518634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] PATH_INFO: `/v3/users/0049d90b851d40d5b39b22416504cc5b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:26.520234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0049d90b851d40d5b39b22416504cc5b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:26.524111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:26.543742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea91d1-7262-44dd-ae34-4d5618e307f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:26.545357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaea91d1-7262-44dd-ae34-4d5618e307f0 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:26.558784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 940/1860] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:26.585786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0049d90b851d40d5b39b22416504cc5b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.598212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0049d90b851d40d5b39b22416504cc5b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.607747 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0049d90b851d40d5b39b22416504cc5b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.615537 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0049d90b851d40d5b39b22416504cc5b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.616245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0049d90b851d40d5b39b22416504cc5b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:26.626315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 921/1861] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:26 2022] DELETE /identity/v3/users/0049d90b851d40d5b39b22416504cc5b => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:26.630804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d48ae-54b1-4d32-bfa7-c67905786ef6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:26.630804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d48ae-54b1-4d32-bfa7-c67905786ef6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:26.630804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d48ae-54b1-4d32-bfa7-c67905786ef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:26.651240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-089d48ae-54b1-4d32-bfa7-c67905786ef6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:26.652455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-089d48ae-54b1-4d32-bfa7-c67905786ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:26.666122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:26.740664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 941/1862] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:26.753154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:26.754908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:26.842543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d2dc9-5f5d-4830-ad57-4af705b35de3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:26.846460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a52151-679b-4672-a5ff-a65d87b53add service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:26.847311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52151-679b-4672-a5ff-a65d87b53add service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:26.847736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52151-679b-4672-a5ff-a65d87b53add service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:26.848148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a52151-679b-4672-a5ff-a65d87b53add service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:26.862642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a52151-679b-4672-a5ff-a65d87b53add service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:26.865600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a52151-679b-4672-a5ff-a65d87b53add service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:26.882838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 922/1863] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:27.006864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d48ae-54b1-4d32-bfa7-c67905786ef6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:27.008354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-089d48ae-54b1-4d32-bfa7-c67905786ef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:27.027355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d48ae-54b1-4d32-bfa7-c67905786ef6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:27.034154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:27.035265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:27.035829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:27.036104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] PATH_INFO: `/v3/projects/f56ca2791df048c8b0ff5f193a21243f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:27.037827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56ca2791df048c8b0ff5f193a21243f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:27.044503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:27.097643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56ca2791df048c8b0ff5f193a21243f', 'request_id': 'req-62435ca3-4939-442e-862c-d15e9ea6e98b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.104394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56ca2791df048c8b0ff5f193a21243f', 'request_id': 'req-62435ca3-4939-442e-862c-d15e9ea6e98b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.114308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56ca2791df048c8b0ff5f193a21243f', 'request_id': 'req-62435ca3-4939-442e-862c-d15e9ea6e98b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.128834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] The token cache is being invalidate because project f56ca2791df048c8b0ff5f193a21243f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:27.129373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.129944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.132397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 942/1864] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:27 2022] DELETE /identity/v3/projects/f56ca2791df048c8b0ff5f193a21243f => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:27.136312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a52151-679b-4672-a5ff-a65d87b53add service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:27.149738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a52151-679b-4672-a5ff-a65d87b53add service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:27.183143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:27.231484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:27.232589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:27.232720 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:27.233153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] PATH_INFO: `/v3/users/3545b631e01b4cdb9fd6d6f2d9525ad1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:27.234552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3545b631e01b4cdb9fd6d6f2d9525ad1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:27.236806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:27.257186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:27.258729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:27.285511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62435ca3-4939-442e-862c-d15e9ea6e98b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:27.291241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:27.292876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:27.293163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:27.293466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] PATH_INFO: `/v3/projects/d6738716b69f46ef8b82f94cdf58aade` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:27.295110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d6738716b69f46ef8b82f94cdf58aade)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:27.296805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:27.312540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3545b631e01b4cdb9fd6d6f2d9525ad1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.331832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3545b631e01b4cdb9fd6d6f2d9525ad1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.344520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3545b631e01b4cdb9fd6d6f2d9525ad1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.356860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3545b631e01b4cdb9fd6d6f2d9525ad1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.357877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3545b631e01b4cdb9fd6d6f2d9525ad1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.369775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 923/1865] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:27 2022] DELETE /identity/v3/users/3545b631e01b4cdb9fd6d6f2d9525ad1 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:27.380981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd6738716b69f46ef8b82f94cdf58aade', 'request_id': 'req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.390369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd6738716b69f46ef8b82f94cdf58aade', 'request_id': 'req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.406165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd6738716b69f46ef8b82f94cdf58aade', 'request_id': 'req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.452178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] The token cache is being invalidate because project d6738716b69f46ef8b82f94cdf58aade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:27.452384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.453376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.455293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 943/1866] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:27 2022] DELETE /identity/v3/projects/d6738716b69f46ef8b82f94cdf58aade => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:27.459815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:27.461508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:27.541106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8274f3-bcd3-44f7-a69f-76ab30d5be71 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:27.546307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:27.547213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:27.548204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:27.548496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] PATH_INFO: `/v3/users/9265025a95e745b0a4efc980eeb85e6b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:27.549863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9265025a95e745b0a4efc980eeb85e6b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:27.551782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:27.624709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9265025a95e745b0a4efc980eeb85e6b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.626703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:27.648309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9265025a95e745b0a4efc980eeb85e6b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.666324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9265025a95e745b0a4efc980eeb85e6b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.684660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9265025a95e745b0a4efc980eeb85e6b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.685685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9265025a95e745b0a4efc980eeb85e6b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:27.693483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 924/1867] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:27 2022] DELETE /identity/v3/users/9265025a95e745b0a4efc980eeb85e6b => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:27.923607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:27.925567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:27.973549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:28.026704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947dad6d-5dc2-4610-96d3-7ee2fcbfde46 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.091286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.092171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.092453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.092727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] PATH_INFO: `/v3/projects/61ba3cf52dff43f8a12539579b2d5755` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.094273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=61ba3cf52dff43f8a12539579b2d5755)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.096282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.152703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.154461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:28.169404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '61ba3cf52dff43f8a12539579b2d5755', 'request_id': 'req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.176068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '61ba3cf52dff43f8a12539579b2d5755', 'request_id': 'req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.177814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8987613-6fc0-4fe6-ab03-eec79616647a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.200092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '61ba3cf52dff43f8a12539579b2d5755', 'request_id': 'req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.224371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] The token cache is being invalidate because project 61ba3cf52dff43f8a12539579b2d5755 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:28.224747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.226264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f7eb11b7-ab4c-4abe-aacb-a02a51293b41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.228217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 944/1868] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:27 2022] DELETE /identity/v3/projects/61ba3cf52dff43f8a12539579b2d5755 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:28.232788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b486464-e2af-40dc-91e4-a622acc91570 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.233154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b486464-e2af-40dc-91e4-a622acc91570 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.233542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b486464-e2af-40dc-91e4-a622acc91570 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.252174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5b486464-e2af-40dc-91e4-a622acc91570 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:28.253395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5b486464-e2af-40dc-91e4-a622acc91570 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:28.257622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.258644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.258897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.259174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] PATH_INFO: `/v3/projects/e6751f7456214b209cdbbceb5a49c351` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.260424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6751f7456214b209cdbbceb5a49c351)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.262172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 945/1869] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:28.268753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.269815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab404-1653-40f2-b572-830927e007b6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.270105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab404-1653-40f2-b572-830927e007b6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.270454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e4ab404-1653-40f2-b572-830927e007b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.290367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0e4ab404-1653-40f2-b572-830927e007b6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:28.291573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0e4ab404-1653-40f2-b572-830927e007b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:28.299456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 946/1870] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:28.304573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab404-1653-40f2-b572-830927e007b6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.314353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e4ab404-1653-40f2-b572-830927e007b6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.326335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6751f7456214b209cdbbceb5a49c351', 'request_id': 'req-bbc2f63b-e83b-4529-bd9b-999318dda855'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.332247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6751f7456214b209cdbbceb5a49c351', 'request_id': 'req-bbc2f63b-e83b-4529-bd9b-999318dda855'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.344309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6751f7456214b209cdbbceb5a49c351', 'request_id': 'req-bbc2f63b-e83b-4529-bd9b-999318dda855'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.359003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] The token cache is being invalidate because project e6751f7456214b209cdbbceb5a49c351 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:28.359313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.360100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bbc2f63b-e83b-4529-bd9b-999318dda855 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:28.362511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 925/1871] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:28 2022] DELETE /identity/v3/projects/e6751f7456214b209cdbbceb5a49c351 => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:28.368643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7798d-8397-4621-95f9-9854f60cb098 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.369803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7798d-8397-4621-95f9-9854f60cb098 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.370283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9c7798d-8397-4621-95f9-9854f60cb098 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.372200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:28.386322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.388306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.389103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.389782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.390755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:28.391562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.394071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.394263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e9c7798d-8397-4621-95f9-9854f60cb098 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:28.395472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9c7798d-8397-4621-95f9-9854f60cb098 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:28.404756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 926/1872] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:28.410102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 947/1873] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 106 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:37:28.415079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212645e-88a1-4bce-b389-a4492aea1cf8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.415355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212645e-88a1-4bce-b389-a4492aea1cf8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.415615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7212645e-88a1-4bce-b389-a4492aea1cf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.419310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.421124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:28.444099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b60f448b-4a02-4cb4-b83a-8be665e995e1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.453366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7212645e-88a1-4bce-b389-a4492aea1cf8 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:28.454658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7212645e-88a1-4bce-b389-a4492aea1cf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:28.456179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659cb96-61d7-4c02-8e61-28d7ace18add admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.456848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659cb96-61d7-4c02-8e61-28d7ace18add admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.457128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659cb96-61d7-4c02-8e61-28d7ace18add admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.457398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3659cb96-61d7-4c02-8e61-28d7ace18add admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.458116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659cb96-61d7-4c02-8e61-28d7ace18add admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.461981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3659cb96-61d7-4c02-8e61-28d7ace18add admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.482262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 927/1874] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:28.486282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212645e-88a1-4bce-b389-a4492aea1cf8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.497698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7212645e-88a1-4bce-b389-a4492aea1cf8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.503009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.506771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 948/1875] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/projects => generated 377 bytes in 86 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:28.506913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.506913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.506913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.506913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:28.506913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.508006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659cb96-61d7-4c02-8e61-28d7ace18add admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.508358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.531491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 928/1876] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:37:28.535574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.546311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bdd510-c207-4564-8c6d-e0d5b20de579 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.587201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3659cb96-61d7-4c02-8e61-28d7ace18add admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.587760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:28.594785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a12d-5ace-42dd-8a40-ce33724d2787 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.595824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a12d-5ace-42dd-8a40-ce33724d2787 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.596297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a12d-5ace-42dd-8a40-ce33724d2787 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.597219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4575a12d-5ace-42dd-8a40-ce33724d2787 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.598392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a12d-5ace-42dd-8a40-ce33724d2787 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.601928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4575a12d-5ace-42dd-8a40-ce33724d2787 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.630966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e755ce-269a-44f6-890e-df2fac46f518 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.631785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e755ce-269a-44f6-890e-df2fac46f518 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.632201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 949/1877] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/users => generated 289 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:28.633752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e755ce-269a-44f6-890e-df2fac46f518 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.634187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64e755ce-269a-44f6-890e-df2fac46f518 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.635834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a12d-5ace-42dd-8a40-ce33724d2787 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.636714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e755ce-269a-44f6-890e-df2fac46f518 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.639232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64e755ce-269a-44f6-890e-df2fac46f518 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.663364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4575a12d-5ace-42dd-8a40-ce33724d2787 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.678492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3b300-8e58-433d-9ea4-509dc1c5c107 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.680401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b300-8e58-433d-9ea4-509dc1c5c107 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.682060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b300-8e58-433d-9ea4-509dc1c5c107 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.682575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc3b300-8e58-433d-9ea4-509dc1c5c107 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.686378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3b300-8e58-433d-9ea4-509dc1c5c107 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.688147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 929/1878] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:28.689897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e755ce-269a-44f6-890e-df2fac46f518 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.690231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc3b300-8e58-433d-9ea4-509dc1c5c107 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.718290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 950/1879] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:28.719388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3b300-8e58-433d-9ea4-509dc1c5c107 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.738833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc3b300-8e58-433d-9ea4-509dc1c5c107 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.801612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64e755ce-269a-44f6-890e-df2fac46f518 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.811828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35301b-2cec-4774-bd6b-868b05eb42b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.812638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35301b-2cec-4774-bd6b-868b05eb42b2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.812982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35301b-2cec-4774-bd6b-868b05eb42b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.813372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b35301b-2cec-4774-bd6b-868b05eb42b2 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.814174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35301b-2cec-4774-bd6b-868b05eb42b2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.816279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b35301b-2cec-4774-bd6b-868b05eb42b2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.817689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cbedb-7e2c-4965-b257-da5adc7bd32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.818788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cbedb-7e2c-4965-b257-da5adc7bd32f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.819142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cbedb-7e2c-4965-b257-da5adc7bd32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.819751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846cbedb-7e2c-4965-b257-da5adc7bd32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.821523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cbedb-7e2c-4965-b257-da5adc7bd32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.829659 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846cbedb-7e2c-4965-b257-da5adc7bd32f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.850981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 930/1880] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/users => generated 291 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:28.851858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35301b-2cec-4774-bd6b-868b05eb42b2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.855146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 951/1881] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:28.856224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cbedb-7e2c-4965-b257-da5adc7bd32f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.862371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b35301b-2cec-4774-bd6b-868b05eb42b2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.868088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846cbedb-7e2c-4965-b257-da5adc7bd32f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.868982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de49a7-a623-4d2e-b396-d6dac1401d7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.869908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de49a7-a623-4d2e-b396-d6dac1401d7f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.870334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de49a7-a623-4d2e-b396-d6dac1401d7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.870610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08de49a7-a623-4d2e-b396-d6dac1401d7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.871383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de49a7-a623-4d2e-b396-d6dac1401d7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.872945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08de49a7-a623-4d2e-b396-d6dac1401d7f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.873620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ea1fff7-ff3e-444a-b4e6-ca5fa1391dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.874630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1fff7-ff3e-444a-b4e6-ca5fa1391dfc admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.874975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1fff7-ff3e-444a-b4e6-ca5fa1391dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.875380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea1fff7-ff3e-444a-b4e6-ca5fa1391dfc admin admin] PATH_INFO: `/v3/projects/621ec2e3004d4e07b656c9788afa6ee8/users/1c59767a6d3c44f7a6b03840aadec6a9/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.887688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 931/1882] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:28.888874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de49a7-a623-4d2e-b396-d6dac1401d7f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.899334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1fff7-ff3e-444a-b4e6-ca5fa1391dfc admin admin] RBAC: Authorizing `identity:create_grant(project_id=621ec2e3004d4e07b656c9788afa6ee8, user_id=1c59767a6d3c44f7a6b03840aadec6a9, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.902405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ea1fff7-ff3e-444a-b4e6-ca5fa1391dfc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.903983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08de49a7-a623-4d2e-b396-d6dac1401d7f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.908942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7dfd-7ff4-49b9-a7ba-d93b07eaa997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:28.909682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7dfd-7ff4-49b9-a7ba-d93b07eaa997 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.910042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7dfd-7ff4-49b9-a7ba-d93b07eaa997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.910295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdc7dfd-7ff4-49b9-a7ba-d93b07eaa997 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.911016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc7dfd-7ff4-49b9-a7ba-d93b07eaa997 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:28.913455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdc7dfd-7ff4-49b9-a7ba-d93b07eaa997 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:28.919897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 952/1883] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:28 2022] PUT /identity/v3/projects/621ec2e3004d4e07b656c9788afa6ee8/users/1c59767a6d3c44f7a6b03840aadec6a9/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:28.926104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 932/1884] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:28 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:28.933144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268563d-8ef5-426e-9318-b88dfe55bc53 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:28.933144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268563d-8ef5-426e-9318-b88dfe55bc53 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:28.933144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9268563d-8ef5-426e-9318-b88dfe55bc53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:28.934610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7dfd-7ff4-49b9-a7ba-d93b07eaa997 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:28.946469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdc7dfd-7ff4-49b9-a7ba-d93b07eaa997 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:28.975831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:28.987740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9268563d-8ef5-426e-9318-b88dfe55bc53 None None] MFA Rules not processed for user `1c59767a6d3c44f7a6b03840aadec6a9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:28.992729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9268563d-8ef5-426e-9318-b88dfe55bc53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:29.057903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804825b-9696-4804-a7e9-143194b61c6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.058793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804825b-9696-4804-a7e9-143194b61c6d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.058925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804825b-9696-4804-a7e9-143194b61c6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.059196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804825b-9696-4804-a7e9-143194b61c6d admin admin] PATH_INFO: `/v3/projects/285ea970c8524e4aae4106a5a7df9273/users/3de0376734a6423eb7cf4ccfc2335d0d/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.083556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804825b-9696-4804-a7e9-143194b61c6d admin admin] RBAC: Authorizing `identity:create_grant(project_id=285ea970c8524e4aae4106a5a7df9273, user_id=3de0376734a6423eb7cf4ccfc2335d0d, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.088655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6804825b-9696-4804-a7e9-143194b61c6d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.100751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 953/1885] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:28 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:29.105133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268563d-8ef5-426e-9318-b88dfe55bc53 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.117477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 933/1886] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:28 2022] PUT /identity/v3/projects/285ea970c8524e4aae4106a5a7df9273/users/3de0376734a6423eb7cf4ccfc2335d0d/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:29.119433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6f23e-1eb0-4b75-8dc2-f666176290f3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.119723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6f23e-1eb0-4b75-8dc2-f666176290f3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.120057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ea6f23e-1eb0-4b75-8dc2-f666176290f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.126606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9268563d-8ef5-426e-9318-b88dfe55bc53 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.141741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:29.152578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8ea6f23e-1eb0-4b75-8dc2-f666176290f3 None None] MFA Rules not processed for user `3de0376734a6423eb7cf4ccfc2335d0d`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:29.154058 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8ea6f23e-1eb0-4b75-8dc2-f666176290f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:29.191434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1d4d-7fe1-4673-b71a-1489da815ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.192126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1d4d-7fe1-4673-b71a-1489da815ba6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.192407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1d4d-7fe1-4673-b71a-1489da815ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.192716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1a1d4d-7fe1-4673-b71a-1489da815ba6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.193523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a1d4d-7fe1-4673-b71a-1489da815ba6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.195444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1a1d4d-7fe1-4673-b71a-1489da815ba6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.227187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 934/1887] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:29.231603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 954/1888] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:29 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:29.231842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6f23e-1eb0-4b75-8dc2-f666176290f3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.232669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1d4d-7fe1-4673-b71a-1489da815ba6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.243688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ea6f23e-1eb0-4b75-8dc2-f666176290f3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.310254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1a1d4d-7fe1-4673-b71a-1489da815ba6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.315991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279bd4-f57a-4df4-a17f-188c85276a14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.316895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279bd4-f57a-4df4-a17f-188c85276a14 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.317361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279bd4-f57a-4df4-a17f-188c85276a14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.318425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9279bd4-f57a-4df4-a17f-188c85276a14 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.319240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9279bd4-f57a-4df4-a17f-188c85276a14 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.321364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9279bd4-f57a-4df4-a17f-188c85276a14 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.335449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a1908-1993-4701-a8a3-20f3a45a89b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.336798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1908-1993-4701-a8a3-20f3a45a89b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.337249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1908-1993-4701-a8a3-20f3a45a89b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.337701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416a1908-1993-4701-a8a3-20f3a45a89b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.338667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a1908-1993-4701-a8a3-20f3a45a89b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.340899 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-416a1908-1993-4701-a8a3-20f3a45a89b0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.356377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 955/1889] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:29 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:29.360440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279bd4-f57a-4df4-a17f-188c85276a14 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.375807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9279bd4-f57a-4df4-a17f-188c85276a14 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.379212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 935/1890] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:29 2022] POST /identity/v3/projects => generated 381 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:37:29.380299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a1908-1993-4701-a8a3-20f3a45a89b0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.400635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:29.470719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416a1908-1993-4701-a8a3-20f3a45a89b0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.477558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182bb35-9d60-4129-b9f5-5e74de00d551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.479285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bb35-9d60-4129-b9f5-5e74de00d551 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.479787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bb35-9d60-4129-b9f5-5e74de00d551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.480266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4182bb35-9d60-4129-b9f5-5e74de00d551 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.481189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182bb35-9d60-4129-b9f5-5e74de00d551 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.483492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4182bb35-9d60-4129-b9f5-5e74de00d551 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.483863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3ef6-4945-424a-91f5-205dd0369580 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.484542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3ef6-4945-424a-91f5-205dd0369580 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.484822 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3ef6-4945-424a-91f5-205dd0369580 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.485095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba7b3ef6-4945-424a-91f5-205dd0369580 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.485971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3ef6-4945-424a-91f5-205dd0369580 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.488428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba7b3ef6-4945-424a-91f5-205dd0369580 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.510020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 936/1891] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:29 2022] POST /identity/v3/users => generated 297 bytes in 130 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:29.510459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 956/1892] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:29.514821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182bb35-9d60-4129-b9f5-5e74de00d551 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.515851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3ef6-4945-424a-91f5-205dd0369580 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.538451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4182bb35-9d60-4129-b9f5-5e74de00d551 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.547493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba7b3ef6-4945-424a-91f5-205dd0369580 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.552412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188db9ab-e704-42e9-b75e-71f4674dd98c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.553670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188db9ab-e704-42e9-b75e-71f4674dd98c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.554227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188db9ab-e704-42e9-b75e-71f4674dd98c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.554714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188db9ab-e704-42e9-b75e-71f4674dd98c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.555769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188db9ab-e704-42e9-b75e-71f4674dd98c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.557727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188db9ab-e704-42e9-b75e-71f4674dd98c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.561298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa51c77-0683-4fe2-b2b4-0ce59e189b1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.563263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51c77-0683-4fe2-b2b4-0ce59e189b1b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.564549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51c77-0683-4fe2-b2b4-0ce59e189b1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.565771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffa51c77-0683-4fe2-b2b4-0ce59e189b1b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.566803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa51c77-0683-4fe2-b2b4-0ce59e189b1b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.570007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffa51c77-0683-4fe2-b2b4-0ce59e189b1b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.576450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 937/1893] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:29.576450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:29.578155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188db9ab-e704-42e9-b75e-71f4674dd98c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.595671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188db9ab-e704-42e9-b75e-71f4674dd98c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.601333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c124ed-d192-47cc-a212-6a854977ff05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.603064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c124ed-d192-47cc-a212-6a854977ff05 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.603064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c124ed-d192-47cc-a212-6a854977ff05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.603277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c124ed-d192-47cc-a212-6a854977ff05 admin admin] PATH_INFO: `/v3/projects/dc6162aaa3bf48c58c7d7444a323dc64/users/784a65fcb03044469a4b1aa6775a5c27/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.607460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 957/1894] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:29.608732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa51c77-0683-4fe2-b2b4-0ce59e189b1b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.627822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c124ed-d192-47cc-a212-6a854977ff05 admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6162aaa3bf48c58c7d7444a323dc64, user_id=784a65fcb03044469a4b1aa6775a5c27, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.628040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffa51c77-0683-4fe2-b2b4-0ce59e189b1b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.628628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d17b499-c163-4461-9129-edb8e4d8a493 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.629608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b499-c163-4461-9129-edb8e4d8a493 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.629898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b499-c163-4461-9129-edb8e4d8a493 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.631060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d17b499-c163-4461-9129-edb8e4d8a493 admin admin] PATH_INFO: `/v3/projects/20722750ae834a279d83f6a5f8c3baff/users/5031732fabc043f09199eb520f3888c4/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.631171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c124ed-d192-47cc-a212-6a854977ff05 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.655022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 938/1895] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:29 2022] PUT /identity/v3/projects/dc6162aaa3bf48c58c7d7444a323dc64/users/784a65fcb03044469a4b1aa6775a5c27/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:29.656364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17b499-c163-4461-9129-edb8e4d8a493 admin admin] RBAC: Authorizing `identity:create_grant(project_id=20722750ae834a279d83f6a5f8c3baff, user_id=5031732fabc043f09199eb520f3888c4, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.668129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c124ed-d192-47cc-a212-6a854977ff05 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.670041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d17b499-c163-4461-9129-edb8e4d8a493 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.725359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 958/1896] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:29 2022] PUT /identity/v3/projects/20722750ae834a279d83f6a5f8c3baff/users/5031732fabc043f09199eb520f3888c4/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:29.728325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e276df-3591-4348-ad65-e53109ef3fc5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.729323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e276df-3591-4348-ad65-e53109ef3fc5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.729785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04e276df-3591-4348-ad65-e53109ef3fc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.778991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-04e276df-3591-4348-ad65-e53109ef3fc5 None None] MFA Rules not processed for user `5031732fabc043f09199eb520f3888c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:29.780393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-04e276df-3591-4348-ad65-e53109ef3fc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:29.801334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c124ed-d192-47cc-a212-6a854977ff05 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.891206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8d1cc8-fe18-4d64-bbbf-8189af0a0cab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.892145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d1cc8-fe18-4d64-bbbf-8189af0a0cab admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.898437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d1cc8-fe18-4d64-bbbf-8189af0a0cab admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.898437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8d1cc8-fe18-4d64-bbbf-8189af0a0cab admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.898437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d1cc8-fe18-4d64-bbbf-8189af0a0cab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.899896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8d1cc8-fe18-4d64-bbbf-8189af0a0cab admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.915778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 939/1897] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:29 2022] GET /identity/v3/roles => generated 1420 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:29.917459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391a38-3d50-4136-9d89-b85c9ec60db3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.918015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391a38-3d50-4136-9d89-b85c9ec60db3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.918593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6391a38-3d50-4136-9d89-b85c9ec60db3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.920905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 940/1898] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:37:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:37:29.921914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6391a38-3d50-4136-9d89-b85c9ec60db3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.925696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 959/1899] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:29.926644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e276df-3591-4348-ad65-e53109ef3fc5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:29.940684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6391a38-3d50-4136-9d89-b85c9ec60db3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.955152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a1e4-8386-4267-af93-ade7c515cd5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.958872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a1e4-8386-4267-af93-ade7c515cd5a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.959332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a1e4-8386-4267-af93-ade7c515cd5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.959758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a1e4-8386-4267-af93-ade7c515cd5a admin admin] PATH_INFO: `/v3/projects/dc6162aaa3bf48c58c7d7444a323dc64/users/784a65fcb03044469a4b1aa6775a5c27/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.962195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581a1e4-8386-4267-af93-ade7c515cd5a admin admin] RBAC: Authorizing `identity:create_grant(project_id=dc6162aaa3bf48c58c7d7444a323dc64, user_id=784a65fcb03044469a4b1aa6775a5c27, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.965704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581a1e4-8386-4267-af93-ade7c515cd5a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.965856 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04e276df-3591-4348-ad65-e53109ef3fc5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:29.978453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954ff99e-8869-4c14-8d6d-30120391c91c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:29.978949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ff99e-8869-4c14-8d6d-30120391c91c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.979234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ff99e-8869-4c14-8d6d-30120391c91c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.980247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954ff99e-8869-4c14-8d6d-30120391c91c admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:29.980589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ff99e-8869-4c14-8d6d-30120391c91c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:29.984871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954ff99e-8869-4c14-8d6d-30120391c91c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:29.986829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 941/1900] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:29 2022] PUT /identity/v3/projects/dc6162aaa3bf48c58c7d7444a323dc64/users/784a65fcb03044469a4b1aa6775a5c27/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:29.988967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370a498-78bd-4020-af4d-86a6fe240a7e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:29.997403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370a498-78bd-4020-af4d-86a6fe240a7e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:29.997984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b370a498-78bd-4020-af4d-86a6fe240a7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.025150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b370a498-78bd-4020-af4d-86a6fe240a7e None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:30.026860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b370a498-78bd-4020-af4d-86a6fe240a7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:30.064217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 960/1901] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:29 2022] POST /identity/v3/projects => generated 379 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:37:30.067575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1671b-7bcd-4a8f-b448-9b7bd9638858 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.067575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1671b-7bcd-4a8f-b448-9b7bd9638858 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.067575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a1671b-7bcd-4a8f-b448-9b7bd9638858 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.111873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:30.128649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 942/1902] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:37:29 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:30.129868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370a498-78bd-4020-af4d-86a6fe240a7e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:30.167601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-91a1671b-7bcd-4a8f-b448-9b7bd9638858 None None] MFA Rules not processed for user `784a65fcb03044469a4b1aa6775a5c27`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:30.169141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-91a1671b-7bcd-4a8f-b448-9b7bd9638858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:30.270897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:30.273748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b370a498-78bd-4020-af4d-86a6fe240a7e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:30.336725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 961/1903] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:30.350292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1671b-7bcd-4a8f-b448-9b7bd9638858 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:30.352557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-91a1671b-7bcd-4a8f-b448-9b7bd9638858 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:30.371957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed42e7b-830b-41b3-aa66-2fac159f8681 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:30.373886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42e7b-830b-41b3-aa66-2fac159f8681 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.374326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42e7b-830b-41b3-aa66-2fac159f8681 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.374862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed42e7b-830b-41b3-aa66-2fac159f8681 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.375855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed42e7b-830b-41b3-aa66-2fac159f8681 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:30.378140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fed42e7b-830b-41b3-aa66-2fac159f8681 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:30.411226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 943/1904] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:30 2022] POST /identity/v3/users => generated 296 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:30.426126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed42e7b-830b-41b3-aa66-2fac159f8681 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:30.444255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed42e7b-830b-41b3-aa66-2fac159f8681 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:30.462130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae359675-b7c4-46a6-a38e-146a0dbc5aba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:30.462949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae359675-b7c4-46a6-a38e-146a0dbc5aba admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.465198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae359675-b7c4-46a6-a38e-146a0dbc5aba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.465901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae359675-b7c4-46a6-a38e-146a0dbc5aba admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.466928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae359675-b7c4-46a6-a38e-146a0dbc5aba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:30.470410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae359675-b7c4-46a6-a38e-146a0dbc5aba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:30.471671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91a1671b-7bcd-4a8f-b448-9b7bd9638858 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:30.483956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8bded-1160-427d-be82-81548106333c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:30.484932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8bded-1160-427d-be82-81548106333c service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.485574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8bded-1160-427d-be82-81548106333c service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.486130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede8bded-1160-427d-be82-81548106333c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.493500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 944/1905] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:30.495194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae359675-b7c4-46a6-a38e-146a0dbc5aba admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:30.514660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8bded-1160-427d-be82-81548106333c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:30.516990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede8bded-1160-427d-be82-81548106333c service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:30.520267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae359675-b7c4-46a6-a38e-146a0dbc5aba admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:30.526155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c71b86-8d81-492d-871f-813f7476f358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:30.527527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71b86-8d81-492d-871f-813f7476f358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.527965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71b86-8d81-492d-871f-813f7476f358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.528665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30c71b86-8d81-492d-871f-813f7476f358 admin admin] PATH_INFO: `/v3/projects/795e1596f418428c8f74850d1039dbbf/users/b7e2b81cfa1440108f9becfaa0c98eb4/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.531510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 962/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:30 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:30.532346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8bded-1160-427d-be82-81548106333c service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:30.533876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ede8bded-1160-427d-be82-81548106333c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:30.558147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c71b86-8d81-492d-871f-813f7476f358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795e1596f418428c8f74850d1039dbbf, user_id=b7e2b81cfa1440108f9becfaa0c98eb4, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:30.561249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30c71b86-8d81-492d-871f-813f7476f358 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:30.599697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 945/1907] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:30 2022] PUT /identity/v3/projects/795e1596f418428c8f74850d1039dbbf/users/b7e2b81cfa1440108f9becfaa0c98eb4/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:30.600782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c71b86-8d81-492d-871f-813f7476f358 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:30.649746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede8bded-1160-427d-be82-81548106333c service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:30.696651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30c71b86-8d81-492d-871f-813f7476f358 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:30.703544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f218fa-a3e5-42d8-b7c4-759300f62309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:30.704449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f218fa-a3e5-42d8-b7c4-759300f62309 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.704992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f218fa-a3e5-42d8-b7c4-759300f62309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.705371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f218fa-a3e5-42d8-b7c4-759300f62309 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.706539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f218fa-a3e5-42d8-b7c4-759300f62309 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:30.712267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f218fa-a3e5-42d8-b7c4-759300f62309 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:30.713145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:30.735773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 946/1908] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:30 2022] GET /identity/v3/roles => generated 1420 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:30.738158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f218fa-a3e5-42d8-b7c4-759300f62309 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:30.753810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f218fa-a3e5-42d8-b7c4-759300f62309 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:30.754825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b159d-b3c9-44fd-96d2-5fc5aadf8dc0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:30.756643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b159d-b3c9-44fd-96d2-5fc5aadf8dc0 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.756955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b159d-b3c9-44fd-96d2-5fc5aadf8dc0 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.757325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b159d-b3c9-44fd-96d2-5fc5aadf8dc0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.769797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b159d-b3c9-44fd-96d2-5fc5aadf8dc0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:30.773152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b159d-b3c9-44fd-96d2-5fc5aadf8dc0 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:30.774242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7a998-afa3-4a7a-beae-9f216d529b72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:30.775308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a998-afa3-4a7a-beae-9f216d529b72 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.775740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a998-afa3-4a7a-beae-9f216d529b72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.776216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc7a998-afa3-4a7a-beae-9f216d529b72 admin admin] PATH_INFO: `/v3/projects/795e1596f418428c8f74850d1039dbbf/users/b7e2b81cfa1440108f9becfaa0c98eb4/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.779110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7a998-afa3-4a7a-beae-9f216d529b72 admin admin] RBAC: Authorizing `identity:create_grant(project_id=795e1596f418428c8f74850d1039dbbf, user_id=b7e2b81cfa1440108f9becfaa0c98eb4, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:30.779751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:30.785783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc7a998-afa3-4a7a-beae-9f216d529b72 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:30.787801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 963/1909] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 256 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:30.805908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 947/1910] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:30 2022] PUT /identity/v3/projects/795e1596f418428c8f74850d1039dbbf/users/b7e2b81cfa1440108f9becfaa0c98eb4/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:30.816807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4515e9-31a6-4c79-b66f-a4d1ab166894 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:30.817167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4515e9-31a6-4c79-b66f-a4d1ab166894 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:30.818158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be4515e9-31a6-4c79-b66f-a4d1ab166894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:30.854481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-be4515e9-31a6-4c79-b66f-a4d1ab166894 None None] MFA Rules not processed for user `b7e2b81cfa1440108f9becfaa0c98eb4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:30.856154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-be4515e9-31a6-4c79-b66f-a4d1ab166894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:30.999073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 964/1911] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:30 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:31.012024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7a998-afa3-4a7a-beae-9f216d529b72 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:31.081266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4515e9-31a6-4c79-b66f-a4d1ab166894 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:31.123035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc7a998-afa3-4a7a-beae-9f216d529b72 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:31.127550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07177-92b4-4410-ac20-16f794d75899 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:31.128351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07177-92b4-4410-ac20-16f794d75899 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:31.128765 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07177-92b4-4410-ac20-16f794d75899 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:31.129050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ca07177-92b4-4410-ac20-16f794d75899 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:31.141453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca07177-92b4-4410-ac20-16f794d75899 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:31.143086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ca07177-92b4-4410-ac20-16f794d75899 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:31.156659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 948/1912] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:31 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:31.188144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be4515e9-31a6-4c79-b66f-a4d1ab166894 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:31.202186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784a65fcb03044469a4b1aa6775a5c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc6162aaa3bf48c58c7d7444a323dc64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:31.203278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:31.203492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:31.203845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:31.204690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:31.205107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:31.209331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:31.235472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07177-92b4-4410-ac20-16f794d75899 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:31.253315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ca07177-92b4-4410-ac20-16f794d75899 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:31.261898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 965/1913] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:37:31.262831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:31.267722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fea689-79ea-4475-943e-44fd13400f02 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:31.268692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea689-79ea-4475-943e-44fd13400f02 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:31.269048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea689-79ea-4475-943e-44fd13400f02 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:31.269552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fea689-79ea-4475-943e-44fd13400f02 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:31.288893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ec8b2d7-987e-402a-8608-104c2f78a8e9 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:31.304123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073ebff-26e2-49d7-bae6-318d59670436 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784a65fcb03044469a4b1aa6775a5c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc6162aaa3bf48c58c7d7444a323dc64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:31.304794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073ebff-26e2-49d7-bae6-318d59670436 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:31.305077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073ebff-26e2-49d7-bae6-318d59670436 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:31.305877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1073ebff-26e2-49d7-bae6-318d59670436 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:31.306649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073ebff-26e2-49d7-bae6-318d59670436 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:31.307981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1073ebff-26e2-49d7-bae6-318d59670436 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:31.361022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 966/1914] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:31 2022] POST /identity/v3/projects => generated 350 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:31.361757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073ebff-26e2-49d7-bae6-318d59670436 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:31.366178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fea689-79ea-4475-943e-44fd13400f02 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:31.368297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26fea689-79ea-4475-943e-44fd13400f02 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:31.382695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 949/1915] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:31.493107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:31.500250 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1073ebff-26e2-49d7-bae6-318d59670436 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:31.507625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784a65fcb03044469a4b1aa6775a5c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc6162aaa3bf48c58c7d7444a323dc64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:31.508209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:31.508500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:31.508987 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:31.510066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:31.510535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:31.512365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:31.546773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 967/1916] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:37:31.607164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fea689-79ea-4475-943e-44fd13400f02 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:31.626911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fea689-79ea-4475-943e-44fd13400f02 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:31.638527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '784a65fcb03044469a4b1aa6775a5c27', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'dc6162aaa3bf48c58c7d7444a323dc64', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:31.639418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:31.639703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:31.639978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] PATH_INFO: `/v3/projects/283a39fb534b415591dbdefe15b40358` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:31.642961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Authorizing `identity:delete_project(project_id=283a39fb534b415591dbdefe15b40358)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:31.649099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:31.783922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '283a39fb534b415591dbdefe15b40358', 'request_id': 'req-740cddb2-48e1-42e5-8dd9-03633fae9787'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:31.811139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '283a39fb534b415591dbdefe15b40358', 'request_id': 'req-740cddb2-48e1-42e5-8dd9-03633fae9787'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:31.833978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '283a39fb534b415591dbdefe15b40358', 'request_id': 'req-740cddb2-48e1-42e5-8dd9-03633fae9787'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:31.860830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] The token cache is being invalidate because project 283a39fb534b415591dbdefe15b40358 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:31.861126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:31.861980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740cddb2-48e1-42e5-8dd9-03633fae9787 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:31.868791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 950/1917] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:31 2022] DELETE /identity/v3/projects/283a39fb534b415591dbdefe15b40358 => generated 0 bytes in 259 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:32.168710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:32.170775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:32.271083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e368468a-a3c4-4398-971c-281aaaced4d3 tempest-VolumeQuotaClassesTest-1934093533 tempest-VolumeQuotaClassesTest-1934093533-project-admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:32.340573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:32.342008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:32.342425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:32.342838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] PATH_INFO: `/v3/users/3de0376734a6423eb7cf4ccfc2335d0d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:32.345628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=3de0376734a6423eb7cf4ccfc2335d0d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:32.347722 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:32.423922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3de0376734a6423eb7cf4ccfc2335d0d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:32.435475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3de0376734a6423eb7cf4ccfc2335d0d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:32.455171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3de0376734a6423eb7cf4ccfc2335d0d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:32.477946 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3de0376734a6423eb7cf4ccfc2335d0d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:32.479208 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3de0376734a6423eb7cf4ccfc2335d0d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:32.485453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 968/1918] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:32 2022] DELETE /identity/v3/users/3de0376734a6423eb7cf4ccfc2335d0d => generated 0 bytes in 317 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:32.490126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da7ab3-d7ec-4c8a-9a61-63dfaab073a1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:32.490648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da7ab3-d7ec-4c8a-9a61-63dfaab073a1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:32.491572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1da7ab3-d7ec-4c8a-9a61-63dfaab073a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:32.509058 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:32.515912 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c1da7ab3-d7ec-4c8a-9a61-63dfaab073a1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:32.517401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c1da7ab3-d7ec-4c8a-9a61-63dfaab073a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:32.588424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 951/1919] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:32.598536 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:32.600646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:32.620427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:32.664790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878de0d6-c05f-4a2e-9ffa-383c076028ff admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:32.668926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1930-255c-483d-9be6-d50cc928513d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:32.669628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1930-255c-483d-9be6-d50cc928513d service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:32.669905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1930-255c-483d-9be6-d50cc928513d service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:32.670176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49bf1930-255c-483d-9be6-d50cc928513d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:32.680936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf1930-255c-483d-9be6-d50cc928513d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:32.682393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49bf1930-255c-483d-9be6-d50cc928513d service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:32.691860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 969/1920] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:33.079609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da7ab3-d7ec-4c8a-9a61-63dfaab073a1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:33.081192 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c1da7ab3-d7ec-4c8a-9a61-63dfaab073a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:33.108405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1da7ab3-d7ec-4c8a-9a61-63dfaab073a1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:33.114142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:33.115935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:33.116367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:33.116678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] PATH_INFO: `/v3/projects/285ea970c8524e4aae4106a5a7df9273` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:33.117978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=285ea970c8524e4aae4106a5a7df9273)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:33.120061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:33.179269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '285ea970c8524e4aae4106a5a7df9273', 'request_id': 'req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.187972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '285ea970c8524e4aae4106a5a7df9273', 'request_id': 'req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.195642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '285ea970c8524e4aae4106a5a7df9273', 'request_id': 'req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.211271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] The token cache is being invalidate because project 285ea970c8524e4aae4106a5a7df9273 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:33.211547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.212219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.213796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 952/1921] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:33 2022] DELETE /identity/v3/projects/285ea970c8524e4aae4106a5a7df9273 => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:33.221262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1930-255c-483d-9be6-d50cc928513d service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:33.228921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49bf1930-255c-483d-9be6-d50cc928513d service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:33.296698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:33.297727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:33.298007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:33.298279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] PATH_INFO: `/v3/users/784a65fcb03044469a4b1aa6775a5c27` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:33.299478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] RBAC: Authorizing `identity:delete_user(user_id=784a65fcb03044469a4b1aa6775a5c27)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:33.301388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:33.355409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '784a65fcb03044469a4b1aa6775a5c27'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.363292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '784a65fcb03044469a4b1aa6775a5c27'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.377594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '784a65fcb03044469a4b1aa6775a5c27'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.403685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '784a65fcb03044469a4b1aa6775a5c27'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.404641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d906fce5-d3a8-4e4b-a991-85fbfba67b0d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '784a65fcb03044469a4b1aa6775a5c27'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:33.416124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 970/1922] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:33 2022] DELETE /identity/v3/users/784a65fcb03044469a4b1aa6775a5c27 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:34.195859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:34.198002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:34.222666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03bce4fb-46a3-4307-ba1c-7c2523f81ef6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:34.353162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:34.354815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:34.355437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:34.355900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] PATH_INFO: `/v3/projects/dc6162aaa3bf48c58c7d7444a323dc64` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:34.358266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=dc6162aaa3bf48c58c7d7444a323dc64)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:34.365617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:34.423103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:34.449176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'dc6162aaa3bf48c58c7d7444a323dc64', 'request_id': 'req-acc112b0-0b42-4986-82ad-6a7969c5a9c2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:34.455851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'dc6162aaa3bf48c58c7d7444a323dc64', 'request_id': 'req-acc112b0-0b42-4986-82ad-6a7969c5a9c2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:34.466596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'dc6162aaa3bf48c58c7d7444a323dc64', 'request_id': 'req-acc112b0-0b42-4986-82ad-6a7969c5a9c2'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:34.498375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] The token cache is being invalidate because project dc6162aaa3bf48c58c7d7444a323dc64 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:34.498687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:34.499316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-acc112b0-0b42-4986-82ad-6a7969c5a9c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:34.503642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 953/1923] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:34 2022] DELETE /identity/v3/projects/dc6162aaa3bf48c58c7d7444a323dc64 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:34.507187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f49318-df35-4c15-a9f9-301b1889069c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:34.507797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f49318-df35-4c15-a9f9-301b1889069c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:34.507797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f49318-df35-4c15-a9f9-301b1889069c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:34.533226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-82f49318-df35-4c15-a9f9-301b1889069c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:34.537839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-82f49318-df35-4c15-a9f9-301b1889069c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:34.580204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:34.623981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 971/1924] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:34.633668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21d7c4-1304-4384-a23d-2e613faa5468 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:34.633983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21d7c4-1304-4384-a23d-2e613faa5468 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:34.634263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e21d7c4-1304-4384-a23d-2e613faa5468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:34.654313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7e21d7c4-1304-4384-a23d-2e613faa5468 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:34.656007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7e21d7c4-1304-4384-a23d-2e613faa5468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:34.666127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 954/1925] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:34.670532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f49318-df35-4c15-a9f9-301b1889069c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:34.681595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f49318-df35-4c15-a9f9-301b1889069c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:34.687808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:34.688582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:34.688862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:34.689240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:34.690148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:34.690457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:34.692594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:34.705438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 972/1926] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:34.709707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21d7c4-1304-4384-a23d-2e613faa5468 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:34.720275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e21d7c4-1304-4384-a23d-2e613faa5468 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:34.731452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:34.731800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:34.732047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:34.732474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:34.733309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:34.735709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:34.769502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 955/1927] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:34 2022] POST /identity/v3/projects => generated 401 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:34.772038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:34.783824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a34620e-902a-4ec3-bd15-129f1d6cdb92 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:34.833896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:34.836263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:34.902179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866920-c794-4882-831f-53ad67c91907 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:34.903050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866920-c794-4882-831f-53ad67c91907 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:34.903597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866920-c794-4882-831f-53ad67c91907 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:34.903924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb866920-c794-4882-831f-53ad67c91907 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:34.904638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866920-c794-4882-831f-53ad67c91907 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:34.906996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb866920-c794-4882-831f-53ad67c91907 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:34.933564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 973/1928] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:34 2022] POST /identity/v3/users => generated 301 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:37:34.937911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866920-c794-4882-831f-53ad67c91907 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:34.945106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d6fd09-e3a9-4dea-bc71-ed487b042674 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:34.950270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:34.951697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:34.952172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:34.952287 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] PATH_INFO: `/v3/users/1c59767a6d3c44f7a6b03840aadec6a9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:34.954358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1c59767a6d3c44f7a6b03840aadec6a9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:34.956886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:34.969516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb866920-c794-4882-831f-53ad67c91907 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:34.981695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e27c67-0af0-41db-b896-820e3d20065b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:34.982729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e27c67-0af0-41db-b896-820e3d20065b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:34.983600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e27c67-0af0-41db-b896-820e3d20065b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:34.984593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e27c67-0af0-41db-b896-820e3d20065b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:34.986367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e27c67-0af0-41db-b896-820e3d20065b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:34.988754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e27c67-0af0-41db-b896-820e3d20065b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.008838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 974/1929] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:34 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:35.010270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e27c67-0af0-41db-b896-820e3d20065b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.025482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e27c67-0af0-41db-b896-820e3d20065b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.026885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1c59767a6d3c44f7a6b03840aadec6a9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:35.031629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93081-1ce0-4017-bab2-3bad38d189ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.032313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93081-1ce0-4017-bab2-3bad38d189ae admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.032597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93081-1ce0-4017-bab2-3bad38d189ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.033003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75f93081-1ce0-4017-bab2-3bad38d189ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.033796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93081-1ce0-4017-bab2-3bad38d189ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.036718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75f93081-1ce0-4017-bab2-3bad38d189ae admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.048591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1c59767a6d3c44f7a6b03840aadec6a9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:35.052032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 975/1930] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:35.053861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93081-1ce0-4017-bab2-3bad38d189ae admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.060451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1c59767a6d3c44f7a6b03840aadec6a9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:35.064210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75f93081-1ce0-4017-bab2-3bad38d189ae admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.068563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1c59767a6d3c44f7a6b03840aadec6a9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:35.069308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c152ed1-d4bb-4bc2-ac62-54177414ed45 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1c59767a6d3c44f7a6b03840aadec6a9'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:35.070142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4860eb7-cf24-41d8-a3b4-53ba5c7c0f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.071057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4860eb7-cf24-41d8-a3b4-53ba5c7c0f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.071337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4860eb7-cf24-41d8-a3b4-53ba5c7c0f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.071605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4860eb7-cf24-41d8-a3b4-53ba5c7c0f91 admin admin] PATH_INFO: `/v3/projects/14bb3e484cfe42a0a2241bea9aed32d9/users/d472188f3dcf4287b3ddde4b1c4ca0e8/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.077100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 956/1931] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:34 2022] DELETE /identity/v3/users/1c59767a6d3c44f7a6b03840aadec6a9 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:35.081553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434cd40-fbc1-4374-99bb-f69148c5a4e9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.081911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434cd40-fbc1-4374-99bb-f69148c5a4e9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.082262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e434cd40-fbc1-4374-99bb-f69148c5a4e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.089115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4860eb7-cf24-41d8-a3b4-53ba5c7c0f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bb3e484cfe42a0a2241bea9aed32d9, user_id=d472188f3dcf4287b3ddde4b1c4ca0e8, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.091854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4860eb7-cf24-41d8-a3b4-53ba5c7c0f91 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.101348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e434cd40-fbc1-4374-99bb-f69148c5a4e9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:35.102612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e434cd40-fbc1-4374-99bb-f69148c5a4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:35.107346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 976/1932] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:35 2022] PUT /identity/v3/projects/14bb3e484cfe42a0a2241bea9aed32d9/users/d472188f3dcf4287b3ddde4b1c4ca0e8/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:35.108179 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=82,keystone:DELETE=15,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:35.118479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7046a3-0294-459f-804f-4ff403522a8b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.118853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7046a3-0294-459f-804f-4ff403522a8b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.119115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7046a3-0294-459f-804f-4ff403522a8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.149168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-de7046a3-0294-459f-804f-4ff403522a8b None None] MFA Rules not processed for user `d472188f3dcf4287b3ddde4b1c4ca0e8`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:35.150515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-de7046a3-0294-459f-804f-4ff403522a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:35.184747 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 957/1933] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:35.197881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434cd40-fbc1-4374-99bb-f69148c5a4e9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.199529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e434cd40-fbc1-4374-99bb-f69148c5a4e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:35.233006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:35.242192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 977/1934] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:35.246777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7046a3-0294-459f-804f-4ff403522a8b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.249777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-de7046a3-0294-459f-804f-4ff403522a8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:35.264540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7046a3-0294-459f-804f-4ff403522a8b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.269904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e434cd40-fbc1-4374-99bb-f69148c5a4e9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.270179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9106e-619e-4dc5-bd05-7a8017268b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.272112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9106e-619e-4dc5-bd05-7a8017268b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.272403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9106e-619e-4dc5-bd05-7a8017268b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.272684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a9106e-619e-4dc5-bd05-7a8017268b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.273532 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9106e-619e-4dc5-bd05-7a8017268b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.275160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2c5a7-58ec-4a8e-aadf-256da3f00df4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.275485 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a9106e-619e-4dc5-bd05-7a8017268b86 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.275814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2c5a7-58ec-4a8e-aadf-256da3f00df4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.276098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2c5a7-58ec-4a8e-aadf-256da3f00df4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.276378 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2c5a7-58ec-4a8e-aadf-256da3f00df4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.291428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2c5a7-58ec-4a8e-aadf-256da3f00df4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.292885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df2c5a7-58ec-4a8e-aadf-256da3f00df4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.313277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 978/1935] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:35 2022] POST /identity/v3/projects => generated 401 bytes in 67 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:37:35.318667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9106e-619e-4dc5-bd05-7a8017268b86 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.325368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 958/1936] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:35.404047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a9106e-619e-4dc5-bd05-7a8017268b86 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.415600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24fc72-11ee-4f1c-b9e5-75074e3293d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.415600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fc72-11ee-4f1c-b9e5-75074e3293d8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.415600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fc72-11ee-4f1c-b9e5-75074e3293d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.415600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad24fc72-11ee-4f1c-b9e5-75074e3293d8 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.416036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24fc72-11ee-4f1c-b9e5-75074e3293d8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.416036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad24fc72-11ee-4f1c-b9e5-75074e3293d8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.439178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 979/1937] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:35 2022] POST /identity/v3/users => generated 307 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:35.443723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2c5a7-58ec-4a8e-aadf-256da3f00df4 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.455455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df2c5a7-58ec-4a8e-aadf-256da3f00df4 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.461519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353173b-6179-4818-a110-517b4d7882f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.462662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353173b-6179-4818-a110-517b4d7882f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.462662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353173b-6179-4818-a110-517b4d7882f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.462850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2353173b-6179-4818-a110-517b4d7882f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.463591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353173b-6179-4818-a110-517b4d7882f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.465796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2353173b-6179-4818-a110-517b4d7882f1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.482844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 959/1938] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:35.483953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24fc72-11ee-4f1c-b9e5-75074e3293d8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.499263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad24fc72-11ee-4f1c-b9e5-75074e3293d8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.504722 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b469f-1fc1-4a92-870b-0b36af2c2fd0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.506629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b469f-1fc1-4a92-870b-0b36af2c2fd0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.507066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b469f-1fc1-4a92-870b-0b36af2c2fd0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.507331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6b469f-1fc1-4a92-870b-0b36af2c2fd0 admin admin] PATH_INFO: `/v3/projects/5f7b4347b1d2490d8929d4796c97bf7d/users/03fdc0eabc364f40a9befc5e37efa487/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.527119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b469f-1fc1-4a92-870b-0b36af2c2fd0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7b4347b1d2490d8929d4796c97bf7d, user_id=03fdc0eabc364f40a9befc5e37efa487, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.530524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6b469f-1fc1-4a92-870b-0b36af2c2fd0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.591797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 980/1939] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:35 2022] PUT /identity/v3/projects/5f7b4347b1d2490d8929d4796c97bf7d/users/03fdc0eabc364f40a9befc5e37efa487/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:35.595832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353173b-6179-4818-a110-517b4d7882f1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.611744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2353173b-6179-4818-a110-517b4d7882f1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.719128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ca49f91-6bc8-4715-abc6-d2b5fd3eaeca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.719884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49f91-6bc8-4715-abc6-d2b5fd3eaeca admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.720173 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49f91-6bc8-4715-abc6-d2b5fd3eaeca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.720528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ca49f91-6bc8-4715-abc6-d2b5fd3eaeca admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.721180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca49f91-6bc8-4715-abc6-d2b5fd3eaeca admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.725161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ca49f91-6bc8-4715-abc6-d2b5fd3eaeca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.744376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 960/1940] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:35 2022] GET /identity/v3/roles => generated 1420 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:35.745569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b469f-1fc1-4a92-870b-0b36af2c2fd0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:35.757448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6b469f-1fc1-4a92-870b-0b36af2c2fd0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:35.764474 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:35.765385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.765709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.765988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] PATH_INFO: `/v3/projects/5f7b4347b1d2490d8929d4796c97bf7d/users/03fdc0eabc364f40a9befc5e37efa487/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.768074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] RBAC: Authorizing `identity:create_grant(project_id=5f7b4347b1d2490d8929d4796c97bf7d, user_id=03fdc0eabc364f40a9befc5e37efa487, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:35.772436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:35.796335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 981/1941] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:35 2022] PUT /identity/v3/projects/5f7b4347b1d2490d8929d4796c97bf7d/users/03fdc0eabc364f40a9befc5e37efa487/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:35.799065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f11db-79bd-4d75-ace0-d8044a5bc488 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:35.799578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f11db-79bd-4d75-ace0-d8044a5bc488 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:35.800088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0f11db-79bd-4d75-ace0-d8044a5bc488 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:35.857467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2d0f11db-79bd-4d75-ace0-d8044a5bc488 None None] MFA Rules not processed for user `03fdc0eabc364f40a9befc5e37efa487`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:35.861572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2d0f11db-79bd-4d75-ace0-d8044a5bc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:35.924198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:35.992564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 961/1942] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:35 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:35.997183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:36.003004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:36.012156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f11db-79bd-4d75-ace0-d8044a5bc488 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:36.013678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2d0f11db-79bd-4d75-ace0-d8044a5bc488 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:36.165898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0f11db-79bd-4d75-ace0-d8044a5bc488 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:36.175211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172a50-2955-4f5c-b74e-78d4c5c18f17 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:36.175891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172a50-2955-4f5c-b74e-78d4c5c18f17 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:36.176179 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172a50-2955-4f5c-b74e-78d4c5c18f17 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:36.176456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04172a50-2955-4f5c-b74e-78d4c5c18f17 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:36.183784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ff47f0-e361-4802-af16-8d399f7a16db admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:36.197292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:36.198749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:36.198749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:36.198957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] PATH_INFO: `/v3/projects/621ec2e3004d4e07b656c9788afa6ee8` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:36.200014 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=621ec2e3004d4e07b656c9788afa6ee8)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:36.205584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:36.226885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04172a50-2955-4f5c-b74e-78d4c5c18f17 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:36.229064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04172a50-2955-4f5c-b74e-78d4c5c18f17 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:36.243108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 962/1943] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:36 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 232 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:36.303136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:INSERT=6,keystone:DELETE=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:36.328753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '621ec2e3004d4e07b656c9788afa6ee8', 'request_id': 'req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.338730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '621ec2e3004d4e07b656c9788afa6ee8', 'request_id': 'req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.352103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '621ec2e3004d4e07b656c9788afa6ee8', 'request_id': 'req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.371208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172a50-2955-4f5c-b74e-78d4c5c18f17 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:36.382704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04172a50-2955-4f5c-b74e-78d4c5c18f17 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:36.385874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] The token cache is being invalidate because project 621ec2e3004d4e07b656c9788afa6ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:36.386309 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.387145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.390077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 982/1944] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:35 2022] DELETE /identity/v3/projects/621ec2e3004d4e07b656c9788afa6ee8 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:36.393813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:36.397631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:36.518135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:36.518809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:36.519096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:36.519372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:36.520897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cf5706-f9e3-4b42-a48e-c450a4bdbf82 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:36.525842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:36.526866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:36.527865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:36.528147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:36.528738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] PATH_INFO: `/v3/users/5031732fabc043f09199eb520f3888c4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:36.530505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5031732fabc043f09199eb520f3888c4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:36.532491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:36.629582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5031732fabc043f09199eb520f3888c4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.640081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5031732fabc043f09199eb520f3888c4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.647591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:36.649342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:36.674430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5031732fabc043f09199eb520f3888c4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.674589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 963/1945] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:36 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:36.720495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5031732fabc043f09199eb520f3888c4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.722444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5031732fabc043f09199eb520f3888c4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:36.742788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 983/1946] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:36 2022] DELETE /identity/v3/users/5031732fabc043f09199eb520f3888c4 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:37.686127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:37.705512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-336928bf-bc7b-4fdb-9c6c-111e3d344494 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:37.738935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:37.805166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:37.806143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:37.806427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:37.807126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] PATH_INFO: `/v3/projects/20722750ae834a279d83f6a5f8c3baff` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:37.808461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20722750ae834a279d83f6a5f8c3baff)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:37.811750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:37.893113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20722750ae834a279d83f6a5f8c3baff', 'request_id': 'req-73b7f690-a4d0-4625-96ab-adb1f52ae199'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:37.900606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20722750ae834a279d83f6a5f8c3baff', 'request_id': 'req-73b7f690-a4d0-4625-96ab-adb1f52ae199'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:37.913265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20722750ae834a279d83f6a5f8c3baff', 'request_id': 'req-73b7f690-a4d0-4625-96ab-adb1f52ae199'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:37.925030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] The token cache is being invalidate because project 20722750ae834a279d83f6a5f8c3baff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:37.925311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:37.925960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:37.928007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 964/1947] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:37 2022] DELETE /identity/v3/projects/20722750ae834a279d83f6a5f8c3baff => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:37.931851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:37.933219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:37.947040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1265545-6660-41da-8ae7-57c6e257cad7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:37.982384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:38.010966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:38.011847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:38.012124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:38.012393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] PATH_INFO: `/v3/users/b7e2b81cfa1440108f9becfaa0c98eb4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:38.013663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] RBAC: Authorizing `identity:delete_user(user_id=b7e2b81cfa1440108f9becfaa0c98eb4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:38.015575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:38.064114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b7e2b81cfa1440108f9becfaa0c98eb4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.071691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b7e2b81cfa1440108f9becfaa0c98eb4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.080324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b7e2b81cfa1440108f9becfaa0c98eb4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.093120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b7e2b81cfa1440108f9becfaa0c98eb4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.093820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b76d0227-c910-409d-be7b-820b8074faaf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b7e2b81cfa1440108f9becfaa0c98eb4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.099635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 984/1948] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:37 2022] DELETE /identity/v3/users/b7e2b81cfa1440108f9becfaa0c98eb4 => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:38.418334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:38.424532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:38.438494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73b7f690-a4d0-4625-96ab-adb1f52ae199 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:38.510750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:38.511614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:38.511893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:38.512168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] PATH_INFO: `/v3/projects/795e1596f418428c8f74850d1039dbbf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:38.513369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] RBAC: Authorizing `identity:delete_project(project_id=795e1596f418428c8f74850d1039dbbf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:38.515322 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:38.564000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '795e1596f418428c8f74850d1039dbbf', 'request_id': 'req-748f28b5-79e9-4d12-97b1-c5b09bf48860'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.568031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:38.570309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '795e1596f418428c8f74850d1039dbbf', 'request_id': 'req-748f28b5-79e9-4d12-97b1-c5b09bf48860'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.579078 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '795e1596f418428c8f74850d1039dbbf', 'request_id': 'req-748f28b5-79e9-4d12-97b1-c5b09bf48860'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.591303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] The token cache is being invalidate because project 795e1596f418428c8f74850d1039dbbf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:38.591590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.592615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-748f28b5-79e9-4d12-97b1-c5b09bf48860 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:38.595043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 965/1949] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:38 2022] DELETE /identity/v3/projects/795e1596f418428c8f74850d1039dbbf => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:38.601698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dacf83-5ff9-47b8-a5d2-b007ea80f923 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:38.601997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dacf83-5ff9-47b8-a5d2-b007ea80f923 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:38.602376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dacf83-5ff9-47b8-a5d2-b007ea80f923 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:38.620925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f6dacf83-5ff9-47b8-a5d2-b007ea80f923 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:38.622480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f6dacf83-5ff9-47b8-a5d2-b007ea80f923 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:38.720930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 985/1950] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:38.723996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74bf3-3ed3-457b-92c2-06df170d37d9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:38.724490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74bf3-3ed3-457b-92c2-06df170d37d9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:38.725860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d74bf3-3ed3-457b-92c2-06df170d37d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:38.751442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-04d74bf3-3ed3-457b-92c2-06df170d37d9 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:38.752681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-04d74bf3-3ed3-457b-92c2-06df170d37d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:38.791276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 966/1951] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:38.796899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dacf83-5ff9-47b8-a5d2-b007ea80f923 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:38.808745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dacf83-5ff9-47b8-a5d2-b007ea80f923 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:38.817597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:38.818409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:38.819623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:38.819976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:38.820854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:38.821166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:38.823670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:38.881174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74bf3-3ed3-457b-92c2-06df170d37d9 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:38.882915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 986/1952] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:38.905837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d74bf3-3ed3-457b-92c2-06df170d37d9 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:38.923002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa58a-f3a7-47c4-8ac1-5ae09b2e6387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:38.925769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa58a-f3a7-47c4-8ac1-5ae09b2e6387 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:38.926277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa58a-f3a7-47c4-8ac1-5ae09b2e6387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:38.926777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e0fa58a-f3a7-47c4-8ac1-5ae09b2e6387 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:38.928854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fa58a-f3a7-47c4-8ac1-5ae09b2e6387 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:38.933059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e0fa58a-f3a7-47c4-8ac1-5ae09b2e6387 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:38.999248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 967/1953] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:38 2022] POST /identity/v3/projects => generated 381 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:39.003469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.021679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8043389e-ae3c-4f85-9496-54cb7eb743cc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.078697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:39.099565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a15c-840b-42d7-8fb8-8224e9c1ffa7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.100514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a15c-840b-42d7-8fb8-8224e9c1ffa7 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.100955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a15c-840b-42d7-8fb8-8224e9c1ffa7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.101388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a2a15c-840b-42d7-8fb8-8224e9c1ffa7 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.102380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a15c-840b-42d7-8fb8-8224e9c1ffa7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.105989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66a2a15c-840b-42d7-8fb8-8224e9c1ffa7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.129867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 987/1954] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:39 2022] POST /identity/v3/users => generated 291 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:39.132896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa58a-f3a7-47c4-8ac1-5ae09b2e6387 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.144132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e0fa58a-f3a7-47c4-8ac1-5ae09b2e6387 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.157332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22dcd2-e800-4024-b363-aa09e1f7c5e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.158383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22dcd2-e800-4024-b363-aa09e1f7c5e4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.158781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22dcd2-e800-4024-b363-aa09e1f7c5e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.159178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c22dcd2-e800-4024-b363-aa09e1f7c5e4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.159915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22dcd2-e800-4024-b363-aa09e1f7c5e4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.162079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c22dcd2-e800-4024-b363-aa09e1f7c5e4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.176341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 968/1955] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:39.181343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a15c-840b-42d7-8fb8-8224e9c1ffa7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.192439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a2a15c-840b-42d7-8fb8-8224e9c1ffa7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.198747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36562342-bc8d-4d07-9db4-57a89e926ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.199523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562342-bc8d-4d07-9db4-57a89e926ddf admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.199878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562342-bc8d-4d07-9db4-57a89e926ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.200224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36562342-bc8d-4d07-9db4-57a89e926ddf admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.201452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36562342-bc8d-4d07-9db4-57a89e926ddf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.202881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36562342-bc8d-4d07-9db4-57a89e926ddf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.217464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 988/1956] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:39.218869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22dcd2-e800-4024-b363-aa09e1f7c5e4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.230979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c22dcd2-e800-4024-b363-aa09e1f7c5e4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.236137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681fe64-8499-44f5-8c09-11038c1f42a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.237032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681fe64-8499-44f5-8c09-11038c1f42a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.237311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681fe64-8499-44f5-8c09-11038c1f42a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.237602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9681fe64-8499-44f5-8c09-11038c1f42a2 admin admin] PATH_INFO: `/v3/projects/4f183d27b0f64b2dbf940ed9a04fe028/users/6e50ac3871f541dd99eb54bdbcdfbdc3/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.257486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681fe64-8499-44f5-8c09-11038c1f42a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4f183d27b0f64b2dbf940ed9a04fe028, user_id=6e50ac3871f541dd99eb54bdbcdfbdc3, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.260484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9681fe64-8499-44f5-8c09-11038c1f42a2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.274582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 969/1957] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:39 2022] PUT /identity/v3/projects/4f183d27b0f64b2dbf940ed9a04fe028/users/6e50ac3871f541dd99eb54bdbcdfbdc3/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:39.287783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582cb5-722a-4aac-9dd0-7637378cd4a5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.288071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582cb5-722a-4aac-9dd0-7637378cd4a5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.288376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23582cb5-722a-4aac-9dd0-7637378cd4a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.319612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-23582cb5-722a-4aac-9dd0-7637378cd4a5 None None] MFA Rules not processed for user `6e50ac3871f541dd99eb54bdbcdfbdc3`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:39.320838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-23582cb5-722a-4aac-9dd0-7637378cd4a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:39.383523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 989/1958] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:39.387950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681fe64-8499-44f5-8c09-11038c1f42a2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.449644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9681fe64-8499-44f5-8c09-11038c1f42a2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.454409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44067-308f-49d0-a66c-60a9df2e2361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.455095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44067-308f-49d0-a66c-60a9df2e2361 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.455469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44067-308f-49d0-a66c-60a9df2e2361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.455763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fea44067-308f-49d0-a66c-60a9df2e2361 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.456704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea44067-308f-49d0-a66c-60a9df2e2361 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.458999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fea44067-308f-49d0-a66c-60a9df2e2361 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.484885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 970/1959] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:39 2022] POST /identity/v3/projects => generated 383 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:39.489011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582cb5-722a-4aac-9dd0-7637378cd4a5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.500484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23582cb5-722a-4aac-9dd0-7637378cd4a5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.558697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b37b-0722-4c03-a9a3-73d4aace27de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.559363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b37b-0722-4c03-a9a3-73d4aace27de admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.559640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b37b-0722-4c03-a9a3-73d4aace27de admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.559910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6b37b-0722-4c03-a9a3-73d4aace27de admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.560605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6b37b-0722-4c03-a9a3-73d4aace27de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.562547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6b37b-0722-4c03-a9a3-73d4aace27de admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.582597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 990/1960] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:39 2022] POST /identity/v3/users => generated 298 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:39.587070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44067-308f-49d0-a66c-60a9df2e2361 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.597323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fea44067-308f-49d0-a66c-60a9df2e2361 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.602027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489dfb6-2c1f-4450-b909-7d2d215d1e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.602719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489dfb6-2c1f-4450-b909-7d2d215d1e71 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.602997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489dfb6-2c1f-4450-b909-7d2d215d1e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.603268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2489dfb6-2c1f-4450-b909-7d2d215d1e71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.603980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489dfb6-2c1f-4450-b909-7d2d215d1e71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.605698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2489dfb6-2c1f-4450-b909-7d2d215d1e71 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.617027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 971/1961] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:39.621255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b37b-0722-4c03-a9a3-73d4aace27de admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.632451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6b37b-0722-4c03-a9a3-73d4aace27de admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.637074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12231f5-c9b9-441b-a799-a66153f48312 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.637918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12231f5-c9b9-441b-a799-a66153f48312 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.638201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12231f5-c9b9-441b-a799-a66153f48312 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.638476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12231f5-c9b9-441b-a799-a66153f48312 admin admin] PATH_INFO: `/v3/projects/05f776ea5c624a46b7b49271d9c91c97/users/22063475210048b39af13601abc49005/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.654689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12231f5-c9b9-441b-a799-a66153f48312 admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f776ea5c624a46b7b49271d9c91c97, user_id=22063475210048b39af13601abc49005, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.657448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12231f5-c9b9-441b-a799-a66153f48312 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.670639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 991/1962] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:39 2022] PUT /identity/v3/projects/05f776ea5c624a46b7b49271d9c91c97/users/22063475210048b39af13601abc49005/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:39.674631 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489dfb6-2c1f-4450-b909-7d2d215d1e71 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.685150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2489dfb6-2c1f-4450-b909-7d2d215d1e71 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.734461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:39.745507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d2457c-4b89-4015-9348-f52dde09e554 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.746331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2457c-4b89-4015-9348-f52dde09e554 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.746766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2457c-4b89-4015-9348-f52dde09e554 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.747251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d2457c-4b89-4015-9348-f52dde09e554 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.747974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2457c-4b89-4015-9348-f52dde09e554 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.749640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d2457c-4b89-4015-9348-f52dde09e554 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.763466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 972/1963] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:39 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:39.764835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12231f5-c9b9-441b-a799-a66153f48312 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.776175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12231f5-c9b9-441b-a799-a66153f48312 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:39.781009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:39.781936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.782215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.782486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] PATH_INFO: `/v3/projects/05f776ea5c624a46b7b49271d9c91c97/users/22063475210048b39af13601abc49005/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.784469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] RBAC: Authorizing `identity:create_grant(project_id=05f776ea5c624a46b7b49271d9c91c97, user_id=22063475210048b39af13601abc49005, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:39.787200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:39.800371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 992/1964] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:39 2022] PUT /identity/v3/projects/05f776ea5c624a46b7b49271d9c91c97/users/22063475210048b39af13601abc49005/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:39.811439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e197cf-e872-4b5e-b70e-e05dc63ae2e0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:39.811726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e197cf-e872-4b5e-b70e-e05dc63ae2e0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:39.811987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e197cf-e872-4b5e-b70e-e05dc63ae2e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:39.843896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-46e197cf-e872-4b5e-b70e-e05dc63ae2e0 None None] MFA Rules not processed for user `22063475210048b39af13601abc49005`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:39.846004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-46e197cf-e872-4b5e-b70e-e05dc63ae2e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:39.927877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 973/1965] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:39 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:39.938828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:39.942313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:39.949952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:40.019613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac965c8-5b06-414f-bfaf-06ac12b5635f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:40.023607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78065bb-79f7-4033-a38c-af4c56d9ab03 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:40.024290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78065bb-79f7-4033-a38c-af4c56d9ab03 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:40.024572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78065bb-79f7-4033-a38c-af4c56d9ab03 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:40.024845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e78065bb-79f7-4033-a38c-af4c56d9ab03 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:40.034975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78065bb-79f7-4033-a38c-af4c56d9ab03 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:40.037540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e78065bb-79f7-4033-a38c-af4c56d9ab03 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:40.047397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 993/1966] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:39 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:40.179702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e197cf-e872-4b5e-b70e-e05dc63ae2e0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:40.190951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e197cf-e872-4b5e-b70e-e05dc63ae2e0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:40.195809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-823c2b88-76ef-4a9b-b246-8916c803d210 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:40.196473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2b88-76ef-4a9b-b246-8916c803d210 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:40.196759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2b88-76ef-4a9b-b246-8916c803d210 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:40.197037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-823c2b88-76ef-4a9b-b246-8916c803d210 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:40.305643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2b88-76ef-4a9b-b246-8916c803d210 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:40.307182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-823c2b88-76ef-4a9b-b246-8916c803d210 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:40.325712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 974/1967] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:40.674704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78065bb-79f7-4033-a38c-af4c56d9ab03 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:40.737731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e78065bb-79f7-4033-a38c-af4c56d9ab03 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:40.742221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:40.743089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:40.743366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:40.743636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] PATH_INFO: `/v3/users/6e50ac3871f541dd99eb54bdbcdfbdc3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:40.744803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6e50ac3871f541dd99eb54bdbcdfbdc3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:40.746764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:40.793528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6e50ac3871f541dd99eb54bdbcdfbdc3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:40.800572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6e50ac3871f541dd99eb54bdbcdfbdc3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:40.808301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6e50ac3871f541dd99eb54bdbcdfbdc3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:40.821300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6e50ac3871f541dd99eb54bdbcdfbdc3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:40.822129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6e50ac3871f541dd99eb54bdbcdfbdc3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:40.828331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 994/1968] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:40 2022] DELETE /identity/v3/users/6e50ac3871f541dd99eb54bdbcdfbdc3 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:40.833662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495982d2-03e0-444d-a911-80e4ede9e51e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:40.834188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495982d2-03e0-444d-a911-80e4ede9e51e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:40.834409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-495982d2-03e0-444d-a911-80e4ede9e51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:40.852998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-495982d2-03e0-444d-a911-80e4ede9e51e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:40.854323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-495982d2-03e0-444d-a911-80e4ede9e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:40.924037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 975/1969] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:40.934419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:40.935847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:40.968049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:41.008104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e5cedb-222b-49ee-84f6-26a0888adf81 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:41.011853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27376-3ab4-45ad-86f1-d8dd32d0f8ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:41.012477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27376-3ab4-45ad-86f1-d8dd32d0f8ac service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:41.012758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27376-3ab4-45ad-86f1-d8dd32d0f8ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:41.013028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eec27376-3ab4-45ad-86f1-d8dd32d0f8ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:41.027457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec27376-3ab4-45ad-86f1-d8dd32d0f8ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:41.030380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eec27376-3ab4-45ad-86f1-d8dd32d0f8ac service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:41.053073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 995/1970] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:41.406040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495982d2-03e0-444d-a911-80e4ede9e51e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:41.408097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-495982d2-03e0-444d-a911-80e4ede9e51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:41.437126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-495982d2-03e0-444d-a911-80e4ede9e51e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:41.446046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:41.446046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:41.446046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:41.446454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] PATH_INFO: `/v3/projects/4f183d27b0f64b2dbf940ed9a04fe028` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:41.448323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] RBAC: Authorizing `identity:delete_project(project_id=4f183d27b0f64b2dbf940ed9a04fe028)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:41.450602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:41.463031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:41.515093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4f183d27b0f64b2dbf940ed9a04fe028', 'request_id': 'req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.526345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4f183d27b0f64b2dbf940ed9a04fe028', 'request_id': 'req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.534488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4f183d27b0f64b2dbf940ed9a04fe028', 'request_id': 'req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.552021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] The token cache is being invalidate because project 4f183d27b0f64b2dbf940ed9a04fe028 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:41.552317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.553671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.555661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 976/1971] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:41 2022] DELETE /identity/v3/projects/4f183d27b0f64b2dbf940ed9a04fe028 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:41.559786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27376-3ab4-45ad-86f1-d8dd32d0f8ac service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:41.575054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eec27376-3ab4-45ad-86f1-d8dd32d0f8ac service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:41.648486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:41.650608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:41.661107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:41.662239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:41.663262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:41.663551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] PATH_INFO: `/v3/users/22063475210048b39af13601abc49005` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:41.664790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22063475210048b39af13601abc49005)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:41.666759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:41.722881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22063475210048b39af13601abc49005'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.729765 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-407b52c5-582e-4c6b-9a65-4d3f0ac714bd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:41.732716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22063475210048b39af13601abc49005'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.734436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:41.735312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:41.735592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:41.735861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] PATH_INFO: `/v3/users/d472188f3dcf4287b3ddde4b1c4ca0e8` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:41.737065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d472188f3dcf4287b3ddde4b1c4ca0e8)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:41.739344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:41.741651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22063475210048b39af13601abc49005'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.753901 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22063475210048b39af13601abc49005'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.754556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22063475210048b39af13601abc49005'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.763883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 996/1972] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:41 2022] DELETE /identity/v3/users/22063475210048b39af13601abc49005 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:41.765373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:41.767187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:41.798188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd472188f3dcf4287b3ddde4b1c4ca0e8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.814794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd472188f3dcf4287b3ddde4b1c4ca0e8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.823803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd472188f3dcf4287b3ddde4b1c4ca0e8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.829140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:41.832308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd472188f3dcf4287b3ddde4b1c4ca0e8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.832990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fedec2d5-f847-4dde-9cca-a9ffcf6116c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd472188f3dcf4287b3ddde4b1c4ca0e8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:41.840436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 977/1973] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:41 2022] DELETE /identity/v3/users/d472188f3dcf4287b3ddde4b1c4ca0e8 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:41.845214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a768-ac0c-494d-be83-7839a2594745 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:41.845556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a768-ac0c-494d-be83-7839a2594745 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:41.845958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28e2a768-ac0c-494d-be83-7839a2594745 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:41.851035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26f5d875-f5cf-4f48-9c7a-3a6a3c2a5c42 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:41.866182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-28e2a768-ac0c-494d-be83-7839a2594745 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:41.867333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28e2a768-ac0c-494d-be83-7839a2594745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:41.880202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:41.919931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:41.926834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:41.927120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:41.928634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] PATH_INFO: `/v3/users/eb290264879942a099605d8ebc6a361a` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:41.930782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eb290264879942a099605d8ebc6a361a)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:41.933792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:41.946934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 978/1974] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:41.955883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2a768-ac0c-494d-be83-7839a2594745 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:41.957368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28e2a768-ac0c-494d-be83-7839a2594745 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:41.996670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eb290264879942a099605d8ebc6a361a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.006869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eb290264879942a099605d8ebc6a361a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.015663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eb290264879942a099605d8ebc6a361a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.024854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28e2a768-ac0c-494d-be83-7839a2594745 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.029034 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.029857 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.030113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eb290264879942a099605d8ebc6a361a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.030578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.030578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.031162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b906330d-6d25-4dad-8719-7389ba3bcec3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eb290264879942a099605d8ebc6a361a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.037819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 997/1975] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:41 2022] DELETE /identity/v3/users/eb290264879942a099605d8ebc6a361a => generated 0 bytes in 273 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:42.041830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.043281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.044101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f66f-43a8-4ad8-9701-c57c54c393d2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.044953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f66f-43a8-4ad8-9701-c57c54c393d2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.045550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720f66f-43a8-4ad8-9701-c57c54c393d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.057270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 979/1976] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:42.063554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.065005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.078327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5720f66f-43a8-4ad8-9701-c57c54c393d2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:42.079743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5720f66f-43a8-4ad8-9701-c57c54c393d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.088596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fc10c89-442a-4eae-bb96-b95988a01799 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.158755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 998/1977] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:42.159704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.160578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.160865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.161144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] PATH_INFO: `/v3/projects/05f776ea5c624a46b7b49271d9c91c97` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.166248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] RBAC: Authorizing `identity:delete_project(project_id=05f776ea5c624a46b7b49271d9c91c97)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.168272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.168486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720f66f-43a8-4ad8-9701-c57c54c393d2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.169998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5720f66f-43a8-4ad8-9701-c57c54c393d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.193046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:42.252139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720f66f-43a8-4ad8-9701-c57c54c393d2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.258853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '05f776ea5c624a46b7b49271d9c91c97', 'request_id': 'req-fe60d53f-c944-43cd-a580-2421cceaca92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.265171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '05f776ea5c624a46b7b49271d9c91c97', 'request_id': 'req-fe60d53f-c944-43cd-a580-2421cceaca92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.268391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:42.277590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '05f776ea5c624a46b7b49271d9c91c97', 'request_id': 'req-fe60d53f-c944-43cd-a580-2421cceaca92'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.293656 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] The token cache is being invalidate because project 05f776ea5c624a46b7b49271d9c91c97 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:42.293967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.294798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-fe60d53f-c944-43cd-a580-2421cceaca92 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.297014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 980/1978] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:42 2022] DELETE /identity/v3/projects/05f776ea5c624a46b7b49271d9c91c97 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:42.301932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86429d2-c961-4391-aca4-8da79a46d764 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.302306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86429d2-c961-4391-aca4-8da79a46d764 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.302694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86429d2-c961-4391-aca4-8da79a46d764 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.313186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa405bac-cf38-4bae-aa77-52b4a31c7599 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.313866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405bac-cf38-4bae-aa77-52b4a31c7599 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.314147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405bac-cf38-4bae-aa77-52b4a31c7599 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.314629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa405bac-cf38-4bae-aa77-52b4a31c7599 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.316585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aa405bac-cf38-4bae-aa77-52b4a31c7599 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.323759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d86429d2-c961-4391-aca4-8da79a46d764 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:42.324944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d86429d2-c961-4391-aca4-8da79a46d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.402316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa405bac-cf38-4bae-aa77-52b4a31c7599 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.404208 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa405bac-cf38-4bae-aa77-52b4a31c7599 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.411146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 981/1979] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:42.421175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86429d2-c961-4391-aca4-8da79a46d764 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.423292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d86429d2-c961-4391-aca4-8da79a46d764 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.425943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 999/1980] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 258 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:42.428803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c25ffe-4d3f-4a36-957f-8fed617a7306 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.428803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c25ffe-4d3f-4a36-957f-8fed617a7306 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.428803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c25ffe-4d3f-4a36-957f-8fed617a7306 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.449723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f4c25ffe-4d3f-4a36-957f-8fed617a7306 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:42.451202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f4c25ffe-4d3f-4a36-957f-8fed617a7306 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.468754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1000/1981] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:42.472270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86429d2-c961-4391-aca4-8da79a46d764 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.473645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c25ffe-4d3f-4a36-957f-8fed617a7306 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.478441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.479305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.479581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.479885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] PATH_INFO: `/v3/projects/14bb3e484cfe42a0a2241bea9aed32d9` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.481343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bb3e484cfe42a0a2241bea9aed32d9)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.484528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.486866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c25ffe-4d3f-4a36-957f-8fed617a7306 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.495170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.496748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.497229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.497726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.499326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:42.499818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.501681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.520325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1001/1982] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:42.521342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.535505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbd3e7e8-5d9e-48d7-a6c0-117dc7bd9b86 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.544146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ace8a8-5225-4745-b88a-ab9a34475f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.545660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace8a8-5225-4745-b88a-ab9a34475f11 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.546356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace8a8-5225-4745-b88a-ab9a34475f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.546882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ace8a8-5225-4745-b88a-ab9a34475f11 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.547874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ace8a8-5225-4745-b88a-ab9a34475f11 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.550688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ace8a8-5225-4745-b88a-ab9a34475f11 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.562606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bb3e484cfe42a0a2241bea9aed32d9', 'request_id': 'req-0c6d52f9-dee0-46f0-a286-b295ecba9729'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.569033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bb3e484cfe42a0a2241bea9aed32d9', 'request_id': 'req-0c6d52f9-dee0-46f0-a286-b295ecba9729'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.577270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bb3e484cfe42a0a2241bea9aed32d9', 'request_id': 'req-0c6d52f9-dee0-46f0-a286-b295ecba9729'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.589679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1002/1983] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:42 2022] POST /identity/v3/projects => generated 371 bytes in 69 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:42.593700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ace8a8-5225-4745-b88a-ab9a34475f11 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.593933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] The token cache is being invalidate because project 14bb3e484cfe42a0a2241bea9aed32d9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:42.594274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.594966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.600606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 982/1984] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:42 2022] DELETE /identity/v3/projects/14bb3e484cfe42a0a2241bea9aed32d9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:42.601548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.603270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.651271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:42.681857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ace8a8-5225-4745-b88a-ab9a34475f11 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.687583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.688527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.688878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.689216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.690087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.692336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.699516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6d52f9-dee0-46f0-a286-b295ecba9729 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.705697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.706743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.707145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.707526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] PATH_INFO: `/v3/users/03fdc0eabc364f40a9befc5e37efa487` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.709768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=03fdc0eabc364f40a9befc5e37efa487)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.711804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.726658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1003/1985] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:42 2022] POST /identity/v3/users => generated 286 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:42.731330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:42.736772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.739699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:42.763372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c16d5d-424e-4c11-8bb5-953578fadff7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.774905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b140e-f8ec-40af-91d6-d03d7e61f59f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.775864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b140e-f8ec-40af-91d6-d03d7e61f59f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.776177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '03fdc0eabc364f40a9befc5e37efa487'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.776579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b140e-f8ec-40af-91d6-d03d7e61f59f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.777051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7b140e-f8ec-40af-91d6-d03d7e61f59f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.779123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b140e-f8ec-40af-91d6-d03d7e61f59f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.782002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7b140e-f8ec-40af-91d6-d03d7e61f59f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.791208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '03fdc0eabc364f40a9befc5e37efa487'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.807530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1004/1986] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:42.809723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b140e-f8ec-40af-91d6-d03d7e61f59f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.810534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '03fdc0eabc364f40a9befc5e37efa487'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.821398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '03fdc0eabc364f40a9befc5e37efa487'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.822202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '03fdc0eabc364f40a9befc5e37efa487'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:42.834698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 983/1987] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:42 2022] DELETE /identity/v3/users/03fdc0eabc364f40a9befc5e37efa487 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:42.846859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7b140e-f8ec-40af-91d6-d03d7e61f59f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:42.964600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:42.965605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:42.966087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:42.966460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:42.967467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:42.969409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:42.986191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1005/1988] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:42 2022] GET /identity/v3/roles => generated 1420 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:42.990664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:42.992661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.001735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.004650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.014942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-524d1725-49ca-42b3-bc4a-c337d21acbb0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.029464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-009f0ffe-f4c2-4ca1-aa6a-c84dd541cf55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.030276 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10e016e-ecac-4a74-a727-9475680e4201 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.030734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0ffe-f4c2-4ca1-aa6a-c84dd541cf55 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.030734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0ffe-f4c2-4ca1-aa6a-c84dd541cf55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.030966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-009f0ffe-f4c2-4ca1-aa6a-c84dd541cf55 admin admin] PATH_INFO: `/v3/projects/014e0a1e1fe040158b25f92e4a845ba5/users/8582b79bf6854fe09ef85379de58b58f/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.035875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.037494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.037799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.038078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] PATH_INFO: `/v3/projects/9c2b9d104e624bc28e635e311f7d35f5` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.039647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9c2b9d104e624bc28e635e311f7d35f5)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.041646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.051544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f0ffe-f4c2-4ca1-aa6a-c84dd541cf55 admin admin] RBAC: Authorizing `identity:create_grant(project_id=014e0a1e1fe040158b25f92e4a845ba5, user_id=8582b79bf6854fe09ef85379de58b58f, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.054623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-009f0ffe-f4c2-4ca1-aa6a-c84dd541cf55 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.072311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 984/1989] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:42 2022] PUT /identity/v3/projects/014e0a1e1fe040158b25f92e4a845ba5/users/8582b79bf6854fe09ef85379de58b58f/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 82 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:43.083494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557406e-3175-4539-b2b0-78879d04d756 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.083494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557406e-3175-4539-b2b0-78879d04d756 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.084515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557406e-3175-4539-b2b0-78879d04d756 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.111600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9c2b9d104e624bc28e635e311f7d35f5', 'request_id': 'req-14cc2c95-2797-4e72-88aa-865a5ba0cc72'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.120013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9c2b9d104e624bc28e635e311f7d35f5', 'request_id': 'req-14cc2c95-2797-4e72-88aa-865a5ba0cc72'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.133398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9557406e-3175-4539-b2b0-78879d04d756 None None] MFA Rules not processed for user `8582b79bf6854fe09ef85379de58b58f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:43.134814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9c2b9d104e624bc28e635e311f7d35f5', 'request_id': 'req-14cc2c95-2797-4e72-88aa-865a5ba0cc72'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.135577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9557406e-3175-4539-b2b0-78879d04d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.158077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] The token cache is being invalidate because project 9c2b9d104e624bc28e635e311f7d35f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:43.158373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.159090 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-14cc2c95-2797-4e72-88aa-865a5ba0cc72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.161573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1006/1990] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:43 2022] DELETE /identity/v3/projects/9c2b9d104e624bc28e635e311f7d35f5 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:43.167052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba34f5b-200c-4840-a5df-acf2290f5d57 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.167336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba34f5b-200c-4840-a5df-acf2290f5d57 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.167622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba34f5b-200c-4840-a5df-acf2290f5d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.193592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3ba34f5b-200c-4840-a5df-acf2290f5d57 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:43.195087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3ba34f5b-200c-4840-a5df-acf2290f5d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.239155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 985/1991] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:43.243245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:43.250619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557406e-3175-4539-b2b0-78879d04d756 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.252028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9557406e-3175-4539-b2b0-78879d04d756 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.283808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1007/1992] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:43.292886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aca6f8-c509-4360-91fa-2ed8ecf82ee7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.293772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aca6f8-c509-4360-91fa-2ed8ecf82ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.293772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aca6f8-c509-4360-91fa-2ed8ecf82ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.315827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b3aca6f8-c509-4360-91fa-2ed8ecf82ee7 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:43.317070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b3aca6f8-c509-4360-91fa-2ed8ecf82ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.330571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557406e-3175-4539-b2b0-78879d04d756 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.332766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1008/1993] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:43.333947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aca6f8-c509-4360-91fa-2ed8ecf82ee7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.336147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3985a1b-f1fa-4ac1-9803-c9777b9a8bf5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.337035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985a1b-f1fa-4ac1-9803-c9777b9a8bf5 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.337549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985a1b-f1fa-4ac1-9803-c9777b9a8bf5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.338047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3985a1b-f1fa-4ac1-9803-c9777b9a8bf5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.343453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aca6f8-c509-4360-91fa-2ed8ecf82ee7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.349112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3985a1b-f1fa-4ac1-9803-c9777b9a8bf5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.350304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.350980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.351711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3985a1b-f1fa-4ac1-9803-c9777b9a8bf5 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.351843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.352181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.353066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:43.353989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.356842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.358287 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:43.366963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 986/1994] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:37:43.374585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1009/1995] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:43.380153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3985a1b-f1fa-4ac1-9803-c9777b9a8bf5 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.393720 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3985a1b-f1fa-4ac1-9803-c9777b9a8bf5 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.397999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.399827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.402348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661848b-4e02-4801-8010-ec4e60b5b75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.403016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661848b-4e02-4801-8010-ec4e60b5b75e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.403561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661848b-4e02-4801-8010-ec4e60b5b75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.404039 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0661848b-4e02-4801-8010-ec4e60b5b75e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.404745 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661848b-4e02-4801-8010-ec4e60b5b75e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.406840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0661848b-4e02-4801-8010-ec4e60b5b75e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.415075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c70c80c-5e52-4460-b206-d1394740ada3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.420942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.422132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.422411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.422687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] PATH_INFO: `/v3/users/8582b79bf6854fe09ef85379de58b58f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.423945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8582b79bf6854fe09ef85379de58b58f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.425951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.450880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 987/1996] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:43 2022] POST /identity/v3/projects => generated 375 bytes in 72 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:43.456272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661848b-4e02-4801-8010-ec4e60b5b75e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.536242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8582b79bf6854fe09ef85379de58b58f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.555591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8582b79bf6854fe09ef85379de58b58f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.573715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8582b79bf6854fe09ef85379de58b58f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.591532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0661848b-4e02-4801-8010-ec4e60b5b75e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.601050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8582b79bf6854fe09ef85379de58b58f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.602659 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d4f4760e-befd-4a6c-bfa9-490c30e0a6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8582b79bf6854fe09ef85379de58b58f'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.603711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.606758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.607155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.608421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.609771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.615810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.623315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1010/1997] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:43 2022] DELETE /identity/v3/users/8582b79bf6854fe09ef85379de58b58f => generated 0 bytes in 223 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:43.626968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e4cb0-d240-4bd2-99a1-0f90be4e5ab4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.627272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e4cb0-d240-4bd2-99a1-0f90be4e5ab4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.627551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9e4cb0-d240-4bd2-99a1-0f90be4e5ab4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.654912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8b9e4cb0-d240-4bd2-99a1-0f90be4e5ab4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:43.656247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8b9e4cb0-d240-4bd2-99a1-0f90be4e5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.670620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 988/1998] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:43 2022] POST /identity/v3/users => generated 288 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:43.672538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.674927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.688958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3103cb67-41df-4cc5-913f-fbe767941db2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.754712 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1011/1999] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:43.773492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e4cb0-d240-4bd2-99a1-0f90be4e5ab4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.775380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8b9e4cb0-d240-4bd2-99a1-0f90be4e5ab4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.785453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.786450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.786676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.789795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.790851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.793504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.797035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9e4cb0-d240-4bd2-99a1-0f90be4e5ab4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.803667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:43.805356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:43.805356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:43.805356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] PATH_INFO: `/v3/projects/5f7b4347b1d2490d8929d4796c97bf7d` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:43.814455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 989/2000] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:43.816344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.818713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:43.825597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5f7b4347b1d2490d8929d4796c97bf7d)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:43.837348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:43.883990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:43.908020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5f7b4347b1d2490d8929d4796c97bf7d', 'request_id': 'req-6ef0794a-94ec-4580-a408-f3a22520b865'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.912624 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7a6a27f-186c-4122-94dc-b223fdb8dc57 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:43.917514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5f7b4347b1d2490d8929d4796c97bf7d', 'request_id': 'req-6ef0794a-94ec-4580-a408-f3a22520b865'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.929410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5f7b4347b1d2490d8929d4796c97bf7d', 'request_id': 'req-6ef0794a-94ec-4580-a408-f3a22520b865'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.935146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:43.945546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] The token cache is being invalidate because project 5f7b4347b1d2490d8929d4796c97bf7d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:43.945546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.946214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:43.949086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1012/2001] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:43 2022] DELETE /identity/v3/projects/5f7b4347b1d2490d8929d4796c97bf7d => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:43.950259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:43.952809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:44.000128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2d4d2a-4768-4ab1-97b6-a6904c84304d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.000884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d4d2a-4768-4ab1-97b6-a6904c84304d service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.001248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d4d2a-4768-4ab1-97b6-a6904c84304d service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.004084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2d4d2a-4768-4ab1-97b6-a6904c84304d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.010478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ee2d4d2a-4768-4ab1-97b6-a6904c84304d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:44.038330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef0794a-94ec-4580-a408-f3a22520b865 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.044383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca367599-4ce1-4cf5-979c-3107541f9ec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.045672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367599-4ce1-4cf5-979c-3107541f9ec9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.045957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367599-4ce1-4cf5-979c-3107541f9ec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.046231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca367599-4ce1-4cf5-979c-3107541f9ec9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.046964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca367599-4ce1-4cf5-979c-3107541f9ec9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.048702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca367599-4ce1-4cf5-979c-3107541f9ec9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.064422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1013/2002] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:43 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:44.065858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67df1d-a7c5-45bb-b6a4-b9f46cf9cee7 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.066145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67df1d-a7c5-45bb-b6a4-b9f46cf9cee7 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.066972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd67df1d-a7c5-45bb-b6a4-b9f46cf9cee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.087933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fd67df1d-a7c5-45bb-b6a4-b9f46cf9cee7 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:44.089135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fd67df1d-a7c5-45bb-b6a4-b9f46cf9cee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:44.093066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d4d2a-4768-4ab1-97b6-a6904c84304d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.094489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2d4d2a-4768-4ab1-97b6-a6904c84304d service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.105387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1014/2003] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:44.105387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67df1d-a7c5-45bb-b6a4-b9f46cf9cee7 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.107753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 990/2004] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:44.109617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61b22-ab71-41ca-bd30-e2ffb3674d7c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.109617 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61b22-ab71-41ca-bd30-e2ffb3674d7c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.109817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd67df1d-a7c5-45bb-b6a4-b9f46cf9cee7 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.109896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c61b22-ab71-41ca-bd30-e2ffb3674d7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.115761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d60e7d-14ec-444c-9670-4adb14d009a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.116228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60e7d-14ec-444c-9670-4adb14d009a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.116513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60e7d-14ec-444c-9670-4adb14d009a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.116775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d60e7d-14ec-444c-9670-4adb14d009a7 admin admin] PATH_INFO: `/v3/projects/19715c802ae24d69a0ccb55c7490baff/users/7dec70b5c28c4be394c003388862b2e5/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.135930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-56c61b22-ab71-41ca-bd30-e2ffb3674d7c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:44.136229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60e7d-14ec-444c-9670-4adb14d009a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19715c802ae24d69a0ccb55c7490baff, user_id=7dec70b5c28c4be394c003388862b2e5, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.137281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-56c61b22-ab71-41ca-bd30-e2ffb3674d7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:44.139002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67d60e7d-14ec-444c-9670-4adb14d009a7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.150114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 991/2005] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:44.154722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61b22-ab71-41ca-bd30-e2ffb3674d7c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.161502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1015/2006] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:44 2022] PUT /identity/v3/projects/19715c802ae24d69a0ccb55c7490baff/users/7dec70b5c28c4be394c003388862b2e5/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:44.166948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c61b22-ab71-41ca-bd30-e2ffb3674d7c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.174626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c2e01-276e-429f-8af5-0df113f819c0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.174956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c2e01-276e-429f-8af5-0df113f819c0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.175173 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c2e01-276e-429f-8af5-0df113f819c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.217377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-da8c2e01-276e-429f-8af5-0df113f819c0 None None] MFA Rules not processed for user `7dec70b5c28c4be394c003388862b2e5`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:44.219004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-da8c2e01-276e-429f-8af5-0df113f819c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:44.262691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.263373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.263658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.263937 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.264834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:44.265147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.267123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.288695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 992/2007] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:37:44.290127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.314475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5970797f-4dfa-4e64-be27-edcddaed0a9d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.320379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8ab05-4062-4025-9742-831507926608 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.321053 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ab05-4062-4025-9742-831507926608 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.321329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ab05-4062-4025-9742-831507926608 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.321812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d8ab05-4062-4025-9742-831507926608 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.322526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8ab05-4062-4025-9742-831507926608 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.327830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d8ab05-4062-4025-9742-831507926608 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.329279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1016/2008] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:44 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:44.330633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c2e01-276e-429f-8af5-0df113f819c0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.346244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c2e01-276e-429f-8af5-0df113f819c0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.353210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ec1e1-0770-4535-820d-57b048ade4fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.354435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ec1e1-0770-4535-820d-57b048ade4fa admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.355647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ec1e1-0770-4535-820d-57b048ade4fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.356336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-333ec1e1-0770-4535-820d-57b048ade4fa admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.357458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ec1e1-0770-4535-820d-57b048ade4fa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.361721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-333ec1e1-0770-4535-820d-57b048ade4fa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.370096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=6,keystone:SELECT=92,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:44.376358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 993/2009] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:44 2022] POST /identity/v3/projects => generated 383 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:44.385117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8ab05-4062-4025-9742-831507926608 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.414409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1017/2010] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:44 2022] POST /identity/v3/projects => generated 373 bytes in 84 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:44.415752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ec1e1-0770-4535-820d-57b048ade4fa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.476807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:44.510642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d8ab05-4062-4025-9742-831507926608 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.594935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bff16a-7d9c-475b-a7b3-8462a587abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.600880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-333ec1e1-0770-4535-820d-57b048ade4fa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.605225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bff16a-7d9c-475b-a7b3-8462a587abfa admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.605815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bff16a-7d9c-475b-a7b3-8462a587abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.606143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61bff16a-7d9c-475b-a7b3-8462a587abfa admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.607353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bff16a-7d9c-475b-a7b3-8462a587abfa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.610275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61bff16a-7d9c-475b-a7b3-8462a587abfa admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.621631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c61d3-a305-44fb-9932-9dcbab0d016e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.622568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c61d3-a305-44fb-9932-9dcbab0d016e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.625095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c61d3-a305-44fb-9932-9dcbab0d016e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.625568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9c61d3-a305-44fb-9932-9dcbab0d016e admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.626922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c61d3-a305-44fb-9932-9dcbab0d016e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.633165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9c61d3-a305-44fb-9932-9dcbab0d016e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.643890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 994/2011] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:44 2022] POST /identity/v3/users => generated 292 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:44.648848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bff16a-7d9c-475b-a7b3-8462a587abfa admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.668531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61bff16a-7d9c-475b-a7b3-8462a587abfa admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.677314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b61b-5ab3-4c3f-8311-42f3f8e7329f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.679146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b61b-5ab3-4c3f-8311-42f3f8e7329f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.679774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b61b-5ab3-4c3f-8311-42f3f8e7329f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.680860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b7b61b-5ab3-4c3f-8311-42f3f8e7329f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.681862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b61b-5ab3-4c3f-8311-42f3f8e7329f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.684821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b7b61b-5ab3-4c3f-8311-42f3f8e7329f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.696693 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1018/2012] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:44 2022] POST /identity/v3/users => generated 293 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:44.702901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 995/2013] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:44.702901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b61b-5ab3-4c3f-8311-42f3f8e7329f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.704431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c61d3-a305-44fb-9932-9dcbab0d016e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.752898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b7b61b-5ab3-4c3f-8311-42f3f8e7329f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.758635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9c61d3-a305-44fb-9932-9dcbab0d016e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.778893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdda43-9f0e-4aef-ad5a-9a93e3717606 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.779939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdda43-9f0e-4aef-ad5a-9a93e3717606 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.780539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdda43-9f0e-4aef-ad5a-9a93e3717606 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.780954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215944e9-f55f-4d2e-affe-1439e3c553ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.781336 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cdda43-9f0e-4aef-ad5a-9a93e3717606 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.782434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215944e9-f55f-4d2e-affe-1439e3c553ab admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.783088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdda43-9f0e-4aef-ad5a-9a93e3717606 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.783462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215944e9-f55f-4d2e-affe-1439e3c553ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.783852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215944e9-f55f-4d2e-affe-1439e3c553ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.787198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215944e9-f55f-4d2e-affe-1439e3c553ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.788160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cdda43-9f0e-4aef-ad5a-9a93e3717606 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.791456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215944e9-f55f-4d2e-affe-1439e3c553ab admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.808526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 996/2014] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 108 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:44.819093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1019/2015] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:44.819093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215944e9-f55f-4d2e-affe-1439e3c553ab admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.826518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdda43-9f0e-4aef-ad5a-9a93e3717606 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.836014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cdda43-9f0e-4aef-ad5a-9a93e3717606 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.840792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4ce502-b639-448e-9478-a0a8a6e4e889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.841707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce502-b639-448e-9478-a0a8a6e4e889 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.841989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce502-b639-448e-9478-a0a8a6e4e889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.842263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4ce502-b639-448e-9478-a0a8a6e4e889 admin admin] PATH_INFO: `/v3/projects/e8357add81af4eab997b9f97f82714a4/users/41cbb42cb77c40d6b856e01d89f4d743/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.843433 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215944e9-f55f-4d2e-affe-1439e3c553ab admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:44.853235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e13dc-ac6b-4d5c-adff-b1fd22d4d206 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:44.854752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e13dc-ac6b-4d5c-adff-b1fd22d4d206 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.855132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e13dc-ac6b-4d5c-adff-b1fd22d4d206 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.855501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a73e13dc-ac6b-4d5c-adff-b1fd22d4d206 admin admin] PATH_INFO: `/v3/projects/8a3193fe82794052bb24c21ba1b456db/users/bfda10181fe8469c87d49ed44443f2da/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.862355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ce502-b639-448e-9478-a0a8a6e4e889 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e8357add81af4eab997b9f97f82714a4, user_id=41cbb42cb77c40d6b856e01d89f4d743, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.865773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de4ce502-b639-448e-9478-a0a8a6e4e889 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.874966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e13dc-ac6b-4d5c-adff-b1fd22d4d206 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3193fe82794052bb24c21ba1b456db, user_id=bfda10181fe8469c87d49ed44443f2da, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:44.878310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a73e13dc-ac6b-4d5c-adff-b1fd22d4d206 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:44.890551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 997/2016] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:44 2022] PUT /identity/v3/projects/e8357add81af4eab997b9f97f82714a4/users/41cbb42cb77c40d6b856e01d89f4d743/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:44.903518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1fd26-e9c2-47df-a64a-778dab353b1d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:44.903877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1fd26-e9c2-47df-a64a-778dab353b1d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:44.904090 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2af1fd26-e9c2-47df-a64a-778dab353b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:44.907531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1020/2017] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:44 2022] PUT /identity/v3/projects/8a3193fe82794052bb24c21ba1b456db/users/bfda10181fe8469c87d49ed44443f2da/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 91 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:44.911288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e13dc-ac6b-4d5c-adff-b1fd22d4d206 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:44.963784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2af1fd26-e9c2-47df-a64a-778dab353b1d None None] MFA Rules not processed for user `41cbb42cb77c40d6b856e01d89f4d743`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:44.967305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2af1fd26-e9c2-47df-a64a-778dab353b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.015023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a73e13dc-ac6b-4d5c-adff-b1fd22d4d206 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:45.020925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:45.021852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.022242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.022535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.031897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:45.034035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:45.067162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1021/2018] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:44 2022] GET /identity/v3/roles => generated 1420 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:45.068632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:45.075789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.096312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f654645-b3b1-4b27-8e05-c2d0424209d1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:45.107937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:45.108124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.108484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.108762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] PATH_INFO: `/v3/projects/014e0a1e1fe040158b25f92e4a845ba5` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.110122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] RBAC: Authorizing `identity:delete_project(project_id=014e0a1e1fe040158b25f92e4a845ba5)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:45.112221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:45.151012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 998/2019] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:45.151920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1fd26-e9c2-47df-a64a-778dab353b1d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:45.171127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:45.189087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '014e0a1e1fe040158b25f92e4a845ba5', 'request_id': 'req-7d1b8685-477e-4ac2-bff7-9582363e0ded'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.190398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2af1fd26-e9c2-47df-a64a-778dab353b1d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:45.205386 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '014e0a1e1fe040158b25f92e4a845ba5', 'request_id': 'req-7d1b8685-477e-4ac2-bff7-9582363e0ded'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.220395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '014e0a1e1fe040158b25f92e4a845ba5', 'request_id': 'req-7d1b8685-477e-4ac2-bff7-9582363e0ded'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.223359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:45.236102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] The token cache is being invalidate because project 014e0a1e1fe040158b25f92e4a845ba5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:45.236758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.237632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.239495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1022/2020] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:45 2022] DELETE /identity/v3/projects/014e0a1e1fe040158b25f92e4a845ba5 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:45.241440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:45.243031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.327427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5815c5ce-91c4-464a-a3e2-2c38ad3ae751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:45.328597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815c5ce-91c4-464a-a3e2-2c38ad3ae751 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.329049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815c5ce-91c4-464a-a3e2-2c38ad3ae751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.329504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5815c5ce-91c4-464a-a3e2-2c38ad3ae751 admin admin] PATH_INFO: `/v3/projects/8a3193fe82794052bb24c21ba1b456db/users/bfda10181fe8469c87d49ed44443f2da/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.331720 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815c5ce-91c4-464a-a3e2-2c38ad3ae751 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8a3193fe82794052bb24c21ba1b456db, user_id=bfda10181fe8469c87d49ed44443f2da, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:45.336260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5815c5ce-91c4-464a-a3e2-2c38ad3ae751 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:45.351381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 999/2021] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:45 2022] PUT /identity/v3/projects/8a3193fe82794052bb24c21ba1b456db/users/bfda10181fe8469c87d49ed44443f2da/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:45.352872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d87d-2226-40fa-9f37-31d0f43c14f8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.353259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d87d-2226-40fa-9f37-31d0f43c14f8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.353691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e891d87d-2226-40fa-9f37-31d0f43c14f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.375395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1b8685-477e-4ac2-bff7-9582363e0ded admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:45.379958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e891d87d-2226-40fa-9f37-31d0f43c14f8 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:45.382097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e891d87d-2226-40fa-9f37-31d0f43c14f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.465290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1000/2022] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:45.466936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63dac-1c3d-4d85-9971-12189f684e4e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.467299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63dac-1c3d-4d85-9971-12189f684e4e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.467645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b63dac-1c3d-4d85-9971-12189f684e4e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.469085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:45.470548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.471112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.472252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.475885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.527401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e7b63dac-1c3d-4d85-9971-12189f684e4e None None] MFA Rules not processed for user `bfda10181fe8469c87d49ed44443f2da`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:45.529567 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e7b63dac-1c3d-4d85-9971-12189f684e4e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.606452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:45.607908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:45.612583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1001/2023] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:45.625394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1806ef-3a4e-4dcf-b444-d045977189b4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.625394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1806ef-3a4e-4dcf-b444-d045977189b4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.625394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b1806ef-3a4e-4dcf-b444-d045977189b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.640649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1023/2024] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:45 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 400 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:45.641441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:45.648100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.664824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9b1806ef-3a4e-4dcf-b444-d045977189b4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:45.666601 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b1806ef-3a4e-4dcf-b444-d045977189b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.674049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8da37507-a9c9-468a-8db3-60d5b82812fb service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:45.676345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1002/2025] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:45.677233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1806ef-3a4e-4dcf-b444-d045977189b4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:45.679446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9b1806ef-3a4e-4dcf-b444-d045977189b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.681277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:45.683116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.683744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.684246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.686480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.693838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b1806ef-3a4e-4dcf-b444-d045977189b4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:45.700241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:45.701290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.701693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.701979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] PATH_INFO: `/v3/users/41cbb42cb77c40d6b856e01d89f4d743` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.703787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] RBAC: Authorizing `identity:delete_user(user_id=41cbb42cb77c40d6b856e01d89f4d743)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:45.705757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:45.731542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:45.735017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=1,keystone:DELETE=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:45.786824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:45.788008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:45.788384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41cbb42cb77c40d6b856e01d89f4d743'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.805114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1024/2026] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:45 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:45.808078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:45.808984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41cbb42cb77c40d6b856e01d89f4d743'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.824684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41cbb42cb77c40d6b856e01d89f4d743'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.832758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc3b2b0-0ef5-457f-b4f6-2edb52b13fcb service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:45.849287 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41cbb42cb77c40d6b856e01d89f4d743'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.851233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0f4815a2-05c4-4bfd-845b-9716e528e32f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41cbb42cb77c40d6b856e01d89f4d743'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:45.855636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:45.856411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.856642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.856923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.857878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:45.858134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:45.860464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:45.869548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1003/2027] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:45 2022] DELETE /identity/v3/users/41cbb42cb77c40d6b856e01d89f4d743 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:45.875539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4fa0c-8067-49bb-aec8-73215ed821ec None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:45.876471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4fa0c-8067-49bb-aec8-73215ed821ec None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:45.876804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd4fa0c-8067-49bb-aec8-73215ed821ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:45.888789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1025/2028] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:45.889747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:45.892401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:45.911520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5dd4fa0c-8067-49bb-aec8-73215ed821ec None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:45.913286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b17fc61d-6622-4d10-a3ee-c503c3006973 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:45.938252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5dd4fa0c-8067-49bb-aec8-73215ed821ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:46.028073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1004/2029] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:46.038199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4fa0c-8067-49bb-aec8-73215ed821ec None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:46.040075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5dd4fa0c-8067-49bb-aec8-73215ed821ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:46.058690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c4cfe-86e3-4147-b10a-a2923d20441b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:46.060359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c4cfe-86e3-4147-b10a-a2923d20441b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:46.061767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c4cfe-86e3-4147-b10a-a2923d20441b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:46.062530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2c4cfe-86e3-4147-b10a-a2923d20441b admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:46.064182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c4cfe-86e3-4147-b10a-a2923d20441b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:46.072921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2c4cfe-86e3-4147-b10a-a2923d20441b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:46.148612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1026/2030] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:45 2022] POST /identity/v3/projects => generated 371 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:46.151109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c4cfe-86e3-4147-b10a-a2923d20441b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:46.208276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dd4fa0c-8067-49bb-aec8-73215ed821ec None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:46.313620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8252af-2722-4098-81e7-1ca432274932 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:46.314269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8252af-2722-4098-81e7-1ca432274932 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:46.315306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8252af-2722-4098-81e7-1ca432274932 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:46.315660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8252af-2722-4098-81e7-1ca432274932 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:46.328362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:46.352783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2c4cfe-86e3-4147-b10a-a2923d20441b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:46.372736 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db222ee2-8eac-4580-b7ea-f636433fbf54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:46.373701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db222ee2-8eac-4580-b7ea-f636433fbf54 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:46.373796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db222ee2-8eac-4580-b7ea-f636433fbf54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:46.374059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db222ee2-8eac-4580-b7ea-f636433fbf54 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:46.374759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db222ee2-8eac-4580-b7ea-f636433fbf54 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:46.376899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db222ee2-8eac-4580-b7ea-f636433fbf54 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:46.412516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1027/2031] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:46 2022] POST /identity/v3/users => generated 286 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:46.416525 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db222ee2-8eac-4580-b7ea-f636433fbf54 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:46.434587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8252af-2722-4098-81e7-1ca432274932 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:46.436166 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8252af-2722-4098-81e7-1ca432274932 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:46.438200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db222ee2-8eac-4580-b7ea-f636433fbf54 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:46.446169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ab599-3b49-472c-9e45-c19379110320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:46.447407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ab599-3b49-472c-9e45-c19379110320 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:46.447932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ab599-3b49-472c-9e45-c19379110320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:46.448333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1005/2032] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:46.448681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8ab599-3b49-472c-9e45-c19379110320 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:46.449942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ab599-3b49-472c-9e45-c19379110320 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:46.452073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8ab599-3b49-472c-9e45-c19379110320 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:46.470776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1028/2033] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:46.472450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8252af-2722-4098-81e7-1ca432274932 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:46.486791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8252af-2722-4098-81e7-1ca432274932 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:46.499839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-483683f3-6fca-4760-80d8-7e8a8c445e7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:46.500428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483683f3-6fca-4760-80d8-7e8a8c445e7c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:46.500704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483683f3-6fca-4760-80d8-7e8a8c445e7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:46.501061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-483683f3-6fca-4760-80d8-7e8a8c445e7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:46.502014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483683f3-6fca-4760-80d8-7e8a8c445e7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:46.504392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-483683f3-6fca-4760-80d8-7e8a8c445e7c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:46.523997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1006/2034] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:46 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:46.525335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ab599-3b49-472c-9e45-c19379110320 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:46.545452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8ab599-3b49-472c-9e45-c19379110320 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:46.557009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:46.558223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:46.558507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:46.558793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] PATH_INFO: `/v3/projects/7538372bf3494ea9bdf09bcc912f04bf/users/df5fb58c15e648acb9ed2281ae0f47d8/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:46.598413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7538372bf3494ea9bdf09bcc912f04bf, user_id=df5fb58c15e648acb9ed2281ae0f47d8, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:46.606713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:46.610922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:46.642963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1029/2035] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:46 2022] PUT /identity/v3/projects/7538372bf3494ea9bdf09bcc912f04bf/users/df5fb58c15e648acb9ed2281ae0f47d8/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:46.718375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02a0f6-5d27-49b6-9e51-4885ccf7f262 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:46.718667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02a0f6-5d27-49b6-9e51-4885ccf7f262 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:46.719261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f02a0f6-5d27-49b6-9e51-4885ccf7f262 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:46.770534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8f02a0f6-5d27-49b6-9e51-4885ccf7f262 None None] MFA Rules not processed for user `df5fb58c15e648acb9ed2281ae0f47d8`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:46.773370 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8f02a0f6-5d27-49b6-9e51-4885ccf7f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:46.846187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:46.855174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:46.966540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1007/2036] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:46 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:46.989146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02a0f6-5d27-49b6-9e51-4885ccf7f262 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:46.992566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8f02a0f6-5d27-49b6-9e51-4885ccf7f262 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:47.004883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b3a83f-b44c-47dc-bc2f-3347e1a3dd04 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:47.015366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:47.016492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.016777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.017053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] PATH_INFO: `/v3/projects/e8357add81af4eab997b9f97f82714a4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.018347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e8357add81af4eab997b9f97f82714a4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:47.020293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:47.085174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f02a0f6-5d27-49b6-9e51-4885ccf7f262 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:47.085625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e8357add81af4eab997b9f97f82714a4', 'request_id': 'req-f63cd721-2e53-4062-bc6a-d2619b50ae97'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:47.093742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e8357add81af4eab997b9f97f82714a4', 'request_id': 'req-f63cd721-2e53-4062-bc6a-d2619b50ae97'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:47.104117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e8357add81af4eab997b9f97f82714a4', 'request_id': 'req-f63cd721-2e53-4062-bc6a-d2619b50ae97'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:47.118725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] The token cache is being invalidate because project e8357add81af4eab997b9f97f82714a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:47.119031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:47.120077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-f63cd721-2e53-4062-bc6a-d2619b50ae97 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:47.122240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1030/2037] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:46 2022] DELETE /identity/v3/projects/e8357add81af4eab997b9f97f82714a4 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:47.129472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de68ab-be30-4297-8596-c4c4d7255189 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.129472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de68ab-be30-4297-8596-c4c4d7255189 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.130267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2de68ab-be30-4297-8596-c4c4d7255189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.160938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e2de68ab-be30-4297-8596-c4c4d7255189 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:47.162372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e2de68ab-be30-4297-8596-c4c4d7255189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:47.178529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:47.192190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993e107cc04e4ce6b9abd9997c29381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:47.193930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.194782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.195286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.197353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:47.259732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1031/2038] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:47.269047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3448c-4ff8-401a-b19b-a78ae30ac751 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.269333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3448c-4ff8-401a-b19b-a78ae30ac751 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.269634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e3448c-4ff8-401a-b19b-a78ae30ac751 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.286217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:47.288508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:47.303412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-14e3448c-4ff8-401a-b19b-a78ae30ac751 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:47.305105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-14e3448c-4ff8-401a-b19b-a78ae30ac751 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:47.326828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1008/2039] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:46 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:47.332133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1032/2040] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:47.336165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:47.348023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03c9aa20-3c93-4fce-8a85-5604ba7aebda service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:47.359082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:47.359905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.360386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.360729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.361781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:47.362196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:47.364024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:47.385673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1009/2041] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:47.385784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3448c-4ff8-401a-b19b-a78ae30ac751 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:47.401474 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e3448c-4ff8-401a-b19b-a78ae30ac751 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:47.423750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d288b-59ac-4fb6-bfb8-178bfcb6adf6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:47.428944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d288b-59ac-4fb6-bfb8-178bfcb6adf6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.429464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d288b-59ac-4fb6-bfb8-178bfcb6adf6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.429896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a8d288b-59ac-4fb6-bfb8-178bfcb6adf6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.430885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d288b-59ac-4fb6-bfb8-178bfcb6adf6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:47.435590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a8d288b-59ac-4fb6-bfb8-178bfcb6adf6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:47.467322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:47.484196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1033/2042] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:47 2022] POST /identity/v3/projects => generated 371 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:47.488350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:47.501616 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0395f08f-bf9f-4294-b208-f1b32bcddb5e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:47.636941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd12f3-a4ac-46b4-a58a-406b47428a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:47.637643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd12f3-a4ac-46b4-a58a-406b47428a32 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.637911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd12f3-a4ac-46b4-a58a-406b47428a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.638223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fcd12f3-a4ac-46b4-a58a-406b47428a32 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.639018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd12f3-a4ac-46b4-a58a-406b47428a32 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:47.641056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fcd12f3-a4ac-46b4-a58a-406b47428a32 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:47.685491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1010/2043] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:47 2022] POST /identity/v3/users => generated 286 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:47.686698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d288b-59ac-4fb6-bfb8-178bfcb6adf6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:47.698991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a8d288b-59ac-4fb6-bfb8-178bfcb6adf6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:47.704006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215e63d-6ead-4212-b940-12461f387270 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:47.705017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215e63d-6ead-4212-b940-12461f387270 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.705379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215e63d-6ead-4212-b940-12461f387270 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.705796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9215e63d-6ead-4212-b940-12461f387270 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.707092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215e63d-6ead-4212-b940-12461f387270 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:47.708813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9215e63d-6ead-4212-b940-12461f387270 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:47.722813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1034/2044] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:47.727146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd12f3-a4ac-46b4-a58a-406b47428a32 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:47.741102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fcd12f3-a4ac-46b4-a58a-406b47428a32 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:47.762326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c39400c-5dd3-45e7-a178-4b5e4d74c167 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:47.763158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39400c-5dd3-45e7-a178-4b5e4d74c167 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.763532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39400c-5dd3-45e7-a178-4b5e4d74c167 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.763841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c39400c-5dd3-45e7-a178-4b5e4d74c167 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.764695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39400c-5dd3-45e7-a178-4b5e4d74c167 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:47.767191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c39400c-5dd3-45e7-a178-4b5e4d74c167 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:47.785388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1011/2045] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:47 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:47.787535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215e63d-6ead-4212-b940-12461f387270 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:47.808516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9215e63d-6ead-4212-b940-12461f387270 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:47.814342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:47.815785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.816075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.816330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] PATH_INFO: `/v3/projects/e83cda7bad364c248b71e25345483faf/users/9d7d6f60f4684fbf881a0df657dacc76/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.840287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e83cda7bad364c248b71e25345483faf, user_id=9d7d6f60f4684fbf881a0df657dacc76, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:47.844226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:47.860973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1035/2046] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:47 2022] PUT /identity/v3/projects/e83cda7bad364c248b71e25345483faf/users/9d7d6f60f4684fbf881a0df657dacc76/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 75 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:47.866394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00786e-c51c-4976-89e7-96167b882e97 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:47.866738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00786e-c51c-4976-89e7-96167b882e97 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:47.866975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c00786e-c51c-4976-89e7-96167b882e97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:47.885845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5c00786e-c51c-4976-89e7-96167b882e97 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:47.887131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5c00786e-c51c-4976-89e7-96167b882e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:47.981029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1012/2047] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:47.988050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:47.991203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:48.132607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26435f54-7a20-453a-b0ac-dad3c2183d22 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:48.144739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c741400a-ac5c-4951-b63b-282163848f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:48.145705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741400a-ac5c-4951-b63b-282163848f7c service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:48.146116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741400a-ac5c-4951-b63b-282163848f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:48.146595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c741400a-ac5c-4951-b63b-282163848f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:48.180140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741400a-ac5c-4951-b63b-282163848f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:48.182259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c741400a-ac5c-4951-b63b-282163848f7c service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:48.199288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1036/2048] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 212 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:48.795095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00786e-c51c-4976-89e7-96167b882e97 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:48.797324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5c00786e-c51c-4976-89e7-96167b882e97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:48.806902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:48.814206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c00786e-c51c-4976-89e7-96167b882e97 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:48.820879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:48.821816 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:48.822099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:48.822398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] PATH_INFO: `/v3/users/7dec70b5c28c4be394c003388862b2e5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:48.823570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7dec70b5c28c4be394c003388862b2e5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:48.825519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:48.881465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7dec70b5c28c4be394c003388862b2e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:48.908713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7dec70b5c28c4be394c003388862b2e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:48.918072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7dec70b5c28c4be394c003388862b2e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:48.926382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7dec70b5c28c4be394c003388862b2e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:48.926943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7dec70b5c28c4be394c003388862b2e5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:48.934047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1013/2049] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:48 2022] DELETE /identity/v3/users/7dec70b5c28c4be394c003388862b2e5 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:48.938347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69a3d-eb2f-40a2-8928-0035df7a8e2b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:48.938636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69a3d-eb2f-40a2-8928-0035df7a8e2b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:48.938912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0f69a3d-eb2f-40a2-8928-0035df7a8e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:48.965829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d0f69a3d-eb2f-40a2-8928-0035df7a8e2b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:48.967061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d0f69a3d-eb2f-40a2-8928-0035df7a8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:49.041548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1037/2050] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:37:49.051230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:49.053259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:49.125008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1da3ff4e-a20b-4484-a41b-df8e2baab650 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:49.130242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2828a8c-f73a-4855-aed8-75c3bd0b6f7c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:49.131719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828a8c-f73a-4855-aed8-75c3bd0b6f7c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:49.131941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828a8c-f73a-4855-aed8-75c3bd0b6f7c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:49.132335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2828a8c-f73a-4855-aed8-75c3bd0b6f7c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:49.153946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2828a8c-f73a-4855-aed8-75c3bd0b6f7c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:49.153946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2828a8c-f73a-4855-aed8-75c3bd0b6f7c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:49.164050 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1014/2051] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:49.618620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f69a3d-eb2f-40a2-8928-0035df7a8e2b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:49.620275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d0f69a3d-eb2f-40a2-8928-0035df7a8e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:49.640107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0f69a3d-eb2f-40a2-8928-0035df7a8e2b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:49.646682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:49.647329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:49.647689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:49.648043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] PATH_INFO: `/v3/projects/19715c802ae24d69a0ccb55c7490baff` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:49.650559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=19715c802ae24d69a0ccb55c7490baff)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:49.652496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:49.721997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19715c802ae24d69a0ccb55c7490baff', 'request_id': 'req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:49.739305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19715c802ae24d69a0ccb55c7490baff', 'request_id': 'req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:49.749609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19715c802ae24d69a0ccb55c7490baff', 'request_id': 'req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:49.752997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:49.770125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] The token cache is being invalidate because project 19715c802ae24d69a0ccb55c7490baff was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:49.770857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:49.772043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:49.774358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1038/2052] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:49 2022] DELETE /identity/v3/projects/19715c802ae24d69a0ccb55c7490baff => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:49.778176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2828a8c-f73a-4855-aed8-75c3bd0b6f7c service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:49.791812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2828a8c-f73a-4855-aed8-75c3bd0b6f7c service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:49.880892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:49.882350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:49.882732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:49.883288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] PATH_INFO: `/v3/users/bfda10181fe8469c87d49ed44443f2da` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:49.884722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bfda10181fe8469c87d49ed44443f2da)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:49.887031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:49.916628 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:49.965815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bfda10181fe8469c87d49ed44443f2da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:49.986883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bfda10181fe8469c87d49ed44443f2da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:49.996741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bfda10181fe8469c87d49ed44443f2da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:50.004265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bfda10181fe8469c87d49ed44443f2da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:50.005041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b8afdb22-546a-4dbb-9750-4fc4f3c22e91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bfda10181fe8469c87d49ed44443f2da'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:50.019296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1015/2053] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:49 2022] DELETE /identity/v3/users/bfda10181fe8469c87d49ed44443f2da => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:50.388982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:50.390452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:50.407271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d551ac7-61c9-4fe3-b8be-a8165c8df1c5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:50.481488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:50.482160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:50.482439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:50.482707 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] PATH_INFO: `/v3/projects/8a3193fe82794052bb24c21ba1b456db` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:50.485225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] RBAC: Authorizing `identity:delete_project(project_id=8a3193fe82794052bb24c21ba1b456db)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:50.487264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:50.543694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8a3193fe82794052bb24c21ba1b456db', 'request_id': 'req-3df6f35e-e024-4369-a1d9-c4f54983936a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:50.550570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8a3193fe82794052bb24c21ba1b456db', 'request_id': 'req-3df6f35e-e024-4369-a1d9-c4f54983936a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:50.561128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8a3193fe82794052bb24c21ba1b456db', 'request_id': 'req-3df6f35e-e024-4369-a1d9-c4f54983936a'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:50.573012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] The token cache is being invalidate because project 8a3193fe82794052bb24c21ba1b456db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:50.573304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:50.573980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3df6f35e-e024-4369-a1d9-c4f54983936a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:50.575695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1039/2054] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:50 2022] DELETE /identity/v3/projects/8a3193fe82794052bb24c21ba1b456db => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:50.580640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f5333-3a14-4c04-8113-3adb4fc87f9d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:50.580931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f5333-3a14-4c04-8113-3adb4fc87f9d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:50.581211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7f5333-3a14-4c04-8113-3adb4fc87f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:50.600598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cd7f5333-3a14-4c04-8113-3adb4fc87f9d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:50.602963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cd7f5333-3a14-4c04-8113-3adb4fc87f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:50.678544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1016/2055] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:50.687666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943701d-0e08-4c0e-bf3f-b9c56c147409 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:50.688203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943701d-0e08-4c0e-bf3f-b9c56c147409 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:50.688544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c943701d-0e08-4c0e-bf3f-b9c56c147409 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:50.708120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c943701d-0e08-4c0e-bf3f-b9c56c147409 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:50.709540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c943701d-0e08-4c0e-bf3f-b9c56c147409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:50.717726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1040/2056] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:50.722038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f5333-3a14-4c04-8113-3adb4fc87f9d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:50.733285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7f5333-3a14-4c04-8113-3adb4fc87f9d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:50.737848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:50.738508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:50.738793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:50.739068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:50.740347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:50.740655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:50.742288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:50.759741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1017/2057] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:50.761279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943701d-0e08-4c0e-bf3f-b9c56c147409 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:50.770981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c943701d-0e08-4c0e-bf3f-b9c56c147409 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:50.777694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff63a49-1320-4578-80f8-8ada00e01d67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:50.779156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff63a49-1320-4578-80f8-8ada00e01d67 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:50.779442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff63a49-1320-4578-80f8-8ada00e01d67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:50.779716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff63a49-1320-4578-80f8-8ada00e01d67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:50.780418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff63a49-1320-4578-80f8-8ada00e01d67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:50.783667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff63a49-1320-4578-80f8-8ada00e01d67 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:50.821204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1041/2058] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:50 2022] POST /identity/v3/projects => generated 375 bytes in 60 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:50.822541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:50.835530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76d47c47-3f4f-45a7-865c-8056cacb6349 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:50.909368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce07c2-ad2a-4d52-bf88-fa9cd8da1ea2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:50.910210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce07c2-ad2a-4d52-bf88-fa9cd8da1ea2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:50.910546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce07c2-ad2a-4d52-bf88-fa9cd8da1ea2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:50.910903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ce07c2-ad2a-4d52-bf88-fa9cd8da1ea2 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:50.912292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce07c2-ad2a-4d52-bf88-fa9cd8da1ea2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:50.916690 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ce07c2-ad2a-4d52-bf88-fa9cd8da1ea2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:50.939460 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1018/2059] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:50 2022] POST /identity/v3/users => generated 288 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:50.943580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff63a49-1320-4578-80f8-8ada00e01d67 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:50.957755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff63a49-1320-4578-80f8-8ada00e01d67 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:50.968787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4c201-aa7b-4722-b202-affa8c7baebc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:50.969609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c201-aa7b-4722-b202-affa8c7baebc admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:50.969881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c201-aa7b-4722-b202-affa8c7baebc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:50.970363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f4c201-aa7b-4722-b202-affa8c7baebc admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:50.971423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4c201-aa7b-4722-b202-affa8c7baebc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:50.973355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f4c201-aa7b-4722-b202-affa8c7baebc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:50.988483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1042/2060] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:50.996854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce07c2-ad2a-4d52-bf88-fa9cd8da1ea2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:51.035858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ce07c2-ad2a-4d52-bf88-fa9cd8da1ea2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:51.042069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485870ca-9313-42f8-8aaf-a519c707d8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:51.043034 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485870ca-9313-42f8-8aaf-a519c707d8af admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:51.043490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485870ca-9313-42f8-8aaf-a519c707d8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:51.043912 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485870ca-9313-42f8-8aaf-a519c707d8af admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:51.045131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485870ca-9313-42f8-8aaf-a519c707d8af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:51.046950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485870ca-9313-42f8-8aaf-a519c707d8af admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:51.062742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1019/2061] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:50 2022] GET /identity/v3/roles => generated 1420 bytes in 71 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:51.064472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4c201-aa7b-4722-b202-affa8c7baebc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:51.082204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f4c201-aa7b-4722-b202-affa8c7baebc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:51.090710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:51.091694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:51.092170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:51.092641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] PATH_INFO: `/v3/projects/26d88cab29a0436091f043a2dea670a6/users/d50cda212683453f8f180681a7417355/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:51.111167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] RBAC: Authorizing `identity:create_grant(project_id=26d88cab29a0436091f043a2dea670a6, user_id=d50cda212683453f8f180681a7417355, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:51.114196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:51.133465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1043/2062] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:51 2022] PUT /identity/v3/projects/26d88cab29a0436091f043a2dea670a6/users/d50cda212683453f8f180681a7417355/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:51.143353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5498-63d6-47b7-a127-bd878bb15ee9 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:51.143353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5498-63d6-47b7-a127-bd878bb15ee9 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:51.143657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00da5498-63d6-47b7-a127-bd878bb15ee9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:51.150524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=8,keystone:SELECT=88,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:51.175842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-00da5498-63d6-47b7-a127-bd878bb15ee9 None None] MFA Rules not processed for user `d50cda212683453f8f180681a7417355`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:51.177439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-00da5498-63d6-47b7-a127-bd878bb15ee9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:51.283595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1020/2063] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:51.299105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:51.301320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:51.341487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=9,keystone:SELECT=88,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:51.437807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85b0e209-d5f8-4ecb-9c95-d58c776bedba admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:51.447926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:51.449391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:51.449855 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:51.450341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:51.472105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:51.473731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:51.485185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1044/2064] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:51 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:53.038944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc95eab-e54c-40d6-b756-3026c9a135ea None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:53.040630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc95eab-e54c-40d6-b756-3026c9a135ea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:53.041082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc95eab-e54c-40d6-b756-3026c9a135ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:53.077939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bcc95eab-e54c-40d6-b756-3026c9a135ea None None] MFA Rules not processed for user `9d7d6f60f4684fbf881a0df657dacc76`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:53.079620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bcc95eab-e54c-40d6-b756-3026c9a135ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:53.153189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1021/2065] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:53 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:53.158152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:53.159675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:53.239218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0505d528-83bf-4885-b63c-e3413bfcc5a8 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:53.244411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c7c5b-55ea-42fd-99a8-313a0a189720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:53.245084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c7c5b-55ea-42fd-99a8-313a0a189720 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:53.245402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c7c5b-55ea-42fd-99a8-313a0a189720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:53.245708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078c7c5b-55ea-42fd-99a8-313a0a189720 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:53.246414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c7c5b-55ea-42fd-99a8-313a0a189720 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:53.248543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078c7c5b-55ea-42fd-99a8-313a0a189720 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:53.281339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc95eab-e54c-40d6-b756-3026c9a135ea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:53.283564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1045/2066] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:53 2022] POST /identity/v3/projects => generated 371 bytes in 125 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:53.292450 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcc95eab-e54c-40d6-b756-3026c9a135ea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:53.387072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734ed6-67f2-4761-8983-797045c62e71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:53.391510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734ed6-67f2-4761-8983-797045c62e71 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:53.391510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734ed6-67f2-4761-8983-797045c62e71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:53.391510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76734ed6-67f2-4761-8983-797045c62e71 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:53.391510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76734ed6-67f2-4761-8983-797045c62e71 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:53.392689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76734ed6-67f2-4761-8983-797045c62e71 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:53.418447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1022/2067] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:53 2022] POST /identity/v3/users => generated 292 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:37:53.425639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c7c5b-55ea-42fd-99a8-313a0a189720 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:53.439614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078c7c5b-55ea-42fd-99a8-313a0a189720 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:53.445450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d7b31-6a2b-4be7-84a0-c4efc60eb8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:53.446188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7b31-6a2b-4be7-84a0-c4efc60eb8b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:53.446533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7b31-6a2b-4be7-84a0-c4efc60eb8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:53.447105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c63d7b31-6a2b-4be7-84a0-c4efc60eb8b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:53.447928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d7b31-6a2b-4be7-84a0-c4efc60eb8b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:53.450163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c63d7b31-6a2b-4be7-84a0-c4efc60eb8b1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:53.468165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1046/2068] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:53.470273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734ed6-67f2-4761-8983-797045c62e71 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:53.493106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76734ed6-67f2-4761-8983-797045c62e71 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:53.499437 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a05d2-9577-474b-b021-13b647be6eb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:53.500736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a05d2-9577-474b-b021-13b647be6eb2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:53.506579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a05d2-9577-474b-b021-13b647be6eb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:53.506954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86a05d2-9577-474b-b021-13b647be6eb2 admin admin] PATH_INFO: `/v3/projects/79d73a6ae65e4c9f839f466ffbad0c2a/users/ec3514b719aa455ebbfcd1b737e9c729/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:53.528892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:53.546349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a05d2-9577-474b-b021-13b647be6eb2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d73a6ae65e4c9f839f466ffbad0c2a, user_id=ec3514b719aa455ebbfcd1b737e9c729, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:53.546349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86a05d2-9577-474b-b021-13b647be6eb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:53.575364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1023/2069] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:53 2022] PUT /identity/v3/projects/79d73a6ae65e4c9f839f466ffbad0c2a/users/ec3514b719aa455ebbfcd1b737e9c729/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:53.579231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d7b31-6a2b-4be7-84a0-c4efc60eb8b1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:53.597112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c63d7b31-6a2b-4be7-84a0-c4efc60eb8b1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:53.680600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c2bd-cdee-4d92-be72-d1e29b9e8573 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:53.681387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c2bd-cdee-4d92-be72-d1e29b9e8573 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:53.681824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c2bd-cdee-4d92-be72-d1e29b9e8573 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:53.682148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc4c2bd-cdee-4d92-be72-d1e29b9e8573 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:53.682956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c2bd-cdee-4d92-be72-d1e29b9e8573 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:53.684635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dc4c2bd-cdee-4d92-be72-d1e29b9e8573 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:53.698264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1047/2070] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:53.702453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a05d2-9577-474b-b021-13b647be6eb2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:53.733672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86a05d2-9577-474b-b021-13b647be6eb2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:53.739164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b3ae2c-01e4-49a1-a937-d02a56c37980 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:53.740582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3ae2c-01e4-49a1-a937-d02a56c37980 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:53.741015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3ae2c-01e4-49a1-a937-d02a56c37980 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:53.741410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b3ae2c-01e4-49a1-a937-d02a56c37980 admin admin] PATH_INFO: `/v3/projects/79d73a6ae65e4c9f839f466ffbad0c2a/users/ec3514b719aa455ebbfcd1b737e9c729/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:53.749769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3ae2c-01e4-49a1-a937-d02a56c37980 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79d73a6ae65e4c9f839f466ffbad0c2a, user_id=ec3514b719aa455ebbfcd1b737e9c729, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:53.756502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b3ae2c-01e4-49a1-a937-d02a56c37980 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:53.775037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1024/2071] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:53 2022] PUT /identity/v3/projects/79d73a6ae65e4c9f839f466ffbad0c2a/users/ec3514b719aa455ebbfcd1b737e9c729/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 73 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:55.000037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c2bd-cdee-4d92-be72-d1e29b9e8573 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:55.011996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc4c2bd-cdee-4d92-be72-d1e29b9e8573 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:55.053723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:55.102981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:55.103775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:55.104316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:55.104661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] PATH_INFO: `/v3/users/d50cda212683453f8f180681a7417355` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:55.106043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d50cda212683453f8f180681a7417355)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:55.108220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:55.186400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd50cda212683453f8f180681a7417355'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:55.194656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd50cda212683453f8f180681a7417355'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:55.211833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd50cda212683453f8f180681a7417355'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:55.228260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd50cda212683453f8f180681a7417355'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:55.229135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd50cda212683453f8f180681a7417355'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:55.236620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1048/2072] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:37:54 2022] DELETE /identity/v3/users/d50cda212683453f8f180681a7417355 => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:55.241849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110917b-faed-438f-b336-94b6f235671e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:55.242363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110917b-faed-438f-b336-94b6f235671e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:55.242630 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a110917b-faed-438f-b336-94b6f235671e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:55.264610 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a110917b-faed-438f-b336-94b6f235671e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:55.265992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a110917b-faed-438f-b336-94b6f235671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:55.337243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1025/2073] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:55.357975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:55.359365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:55.485055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b73270-01d8-469a-8570-5e4ef1c820e5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:55.491627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e53c0d2-6de5-470a-aa4c-7e47a528a6f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:55.492465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53c0d2-6de5-470a-aa4c-7e47a528a6f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:55.492862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53c0d2-6de5-470a-aa4c-7e47a528a6f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:55.493231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e53c0d2-6de5-470a-aa4c-7e47a528a6f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:55.516519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53c0d2-6de5-470a-aa4c-7e47a528a6f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:55.518323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e53c0d2-6de5-470a-aa4c-7e47a528a6f1 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:55.534949 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1049/2074] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:37:56.187195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110917b-faed-438f-b336-94b6f235671e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:56.188517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a110917b-faed-438f-b336-94b6f235671e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:56.212972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a110917b-faed-438f-b336-94b6f235671e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:56.220070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:56.222163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:56.222844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:56.223358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] PATH_INFO: `/v3/projects/26d88cab29a0436091f043a2dea670a6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:56.225314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] RBAC: Authorizing `identity:delete_project(project_id=26d88cab29a0436091f043a2dea670a6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:56.228558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:56.306175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '26d88cab29a0436091f043a2dea670a6', 'request_id': 'req-058a75b1-c485-491f-b8df-cf406f8da152'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:56.322842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '26d88cab29a0436091f043a2dea670a6', 'request_id': 'req-058a75b1-c485-491f-b8df-cf406f8da152'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:56.334091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '26d88cab29a0436091f043a2dea670a6', 'request_id': 'req-058a75b1-c485-491f-b8df-cf406f8da152'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:56.353272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] The token cache is being invalidate because project 26d88cab29a0436091f043a2dea670a6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:37:56.353583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:56.354293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-058a75b1-c485-491f-b8df-cf406f8da152 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:37:56.356452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1026/2075] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:37:56 2022] DELETE /identity/v3/projects/26d88cab29a0436091f043a2dea670a6 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:37:56.362389 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9082d7-0a63-4a43-83ab-100c3ea35fd3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:56.362930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9082d7-0a63-4a43-83ab-100c3ea35fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:56.363024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9082d7-0a63-4a43-83ab-100c3ea35fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:56.390120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-9f9082d7-0a63-4a43-83ab-100c3ea35fd3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:56.391661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f9082d7-0a63-4a43-83ab-100c3ea35fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:56.465827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:56.495110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1050/2076] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:56.502740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3f0c6-c73d-4204-8b0d-697d6ab45d62 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:56.503031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3f0c6-c73d-4204-8b0d-697d6ab45d62 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:56.503314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cee3f0c6-c73d-4204-8b0d-697d6ab45d62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:56.538903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cee3f0c6-c73d-4204-8b0d-697d6ab45d62 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:56.540608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cee3f0c6-c73d-4204-8b0d-697d6ab45d62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:56.555605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1027/2077] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:56.556427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9082d7-0a63-4a43-83ab-100c3ea35fd3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:56.571526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9082d7-0a63-4a43-83ab-100c3ea35fd3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:56.576729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:56.577431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:56.577716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:56.577992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:56.578728 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:37:56.579079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:56.580704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:56.631541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1051/2078] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:37:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 75 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:37:56.632289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3f0c6-c73d-4204-8b0d-697d6ab45d62 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:56.649867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cee3f0c6-c73d-4204-8b0d-697d6ab45d62 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:56.657443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f52a37-0305-4ab9-9954-e355957e5f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:56.659004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f52a37-0305-4ab9-9954-e355957e5f3f admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:56.659505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f52a37-0305-4ab9-9954-e355957e5f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:56.660647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7f52a37-0305-4ab9-9954-e355957e5f3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:56.661773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f52a37-0305-4ab9-9954-e355957e5f3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:56.664201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7f52a37-0305-4ab9-9954-e355957e5f3f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:56.730688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1028/2079] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:37:56 2022] POST /identity/v3/projects => generated 369 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:56.734922 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:56.746026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a355ec8-e20b-4f0d-96c0-7530eda276fe admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:56.875765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a0b60-794d-486f-aa4f-a8986d7cd16b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:56.877004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a0b60-794d-486f-aa4f-a8986d7cd16b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:56.877297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a0b60-794d-486f-aa4f-a8986d7cd16b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:56.877918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805a0b60-794d-486f-aa4f-a8986d7cd16b admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:56.878710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a0b60-794d-486f-aa4f-a8986d7cd16b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:56.882656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805a0b60-794d-486f-aa4f-a8986d7cd16b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:56.914193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1052/2080] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:37:56 2022] POST /identity/v3/users => generated 285 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:37:56.918259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f52a37-0305-4ab9-9954-e355957e5f3f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:56.936164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7f52a37-0305-4ab9-9954-e355957e5f3f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:56.942228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbfd93-4950-4420-9488-9d409051473f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:56.944598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbfd93-4950-4420-9488-9d409051473f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:56.945209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbfd93-4950-4420-9488-9d409051473f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:56.945759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27cbfd93-4950-4420-9488-9d409051473f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:56.947671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbfd93-4950-4420-9488-9d409051473f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:56.949590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27cbfd93-4950-4420-9488-9d409051473f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:56.967459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1029/2081] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:37:56.971356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a0b60-794d-486f-aa4f-a8986d7cd16b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:56.986040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805a0b60-794d-486f-aa4f-a8986d7cd16b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:56.996702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75450c50-68d3-4bd5-b6d9-bc437852f95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:56.997788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450c50-68d3-4bd5-b6d9-bc437852f95e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:56.998310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450c50-68d3-4bd5-b6d9-bc437852f95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:56.998921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75450c50-68d3-4bd5-b6d9-bc437852f95e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:56.999887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75450c50-68d3-4bd5-b6d9-bc437852f95e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:57.002044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75450c50-68d3-4bd5-b6d9-bc437852f95e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:57.018289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1053/2082] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:37:56 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:37:57.019487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbfd93-4950-4420-9488-9d409051473f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:57.036916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27cbfd93-4950-4420-9488-9d409051473f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:57.042769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:57.043675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:57.043957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:57.044233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] PATH_INFO: `/v3/projects/30fbdddf4bba4c93b5924ccea195f7d3/users/09e541a38adf4b4a9091044e8baf6f51/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:57.075075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=30fbdddf4bba4c93b5924ccea195f7d3, user_id=09e541a38adf4b4a9091044e8baf6f51, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:57.077911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:57.080920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:37:57.118154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1030/2083] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:37:57 2022] PUT /identity/v3/projects/30fbdddf4bba4c93b5924ccea195f7d3/users/09e541a38adf4b4a9091044e8baf6f51/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:37:57.121224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72c276-0c1a-4a29-b5ac-21c4aad0990c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:57.121550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72c276-0c1a-4a29-b5ac-21c4aad0990c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:57.121773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc72c276-0c1a-4a29-b5ac-21c4aad0990c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:57.168708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-bc72c276-0c1a-4a29-b5ac-21c4aad0990c None None] MFA Rules not processed for user `09e541a38adf4b4a9091044e8baf6f51`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:37:57.170033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bc72c276-0c1a-4a29-b5ac-21c4aad0990c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:57.287151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1054/2084] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:37:57 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:37:57.301758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:37:57.304312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:37:57.519606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a334e87-a956-4605-b382-ba3e8bfe73b6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:37:57.539463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993e107cc04e4ce6b9abd9997c29381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:37:57.540347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:37:57.540639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:37:57.540918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:37:57.556155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:37:57.557777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:37:57.578006 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1031/2085] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:37:57 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 277 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:00.285110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073e1f-0da7-45e5-ab90-0d3ff678fd16 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:00.285699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073e1f-0da7-45e5-ab90-0d3ff678fd16 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:00.285699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56073e1f-0da7-45e5-ab90-0d3ff678fd16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:00.343704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-56073e1f-0da7-45e5-ab90-0d3ff678fd16 None None] MFA Rules not processed for user `ec3514b719aa455ebbfcd1b737e9c729`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:00.344964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-56073e1f-0da7-45e5-ab90-0d3ff678fd16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:00.425106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:00.495504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1055/2086] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:00 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:00.507074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:00.509100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:00.621598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0bfd9f-9c3a-40d1-9c79-f96b1e1e6f4a service glance] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:00.621817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0383aa6-60fd-48bb-a956-3a2e4f265fad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:00.622507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383aa6-60fd-48bb-a956-3a2e4f265fad service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:00.622781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383aa6-60fd-48bb-a956-3a2e4f265fad service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:00.623054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0383aa6-60fd-48bb-a956-3a2e4f265fad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:00.624987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e0383aa6-60fd-48bb-a956-3a2e4f265fad service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:00.739633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383aa6-60fd-48bb-a956-3a2e4f265fad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:00.741939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0383aa6-60fd-48bb-a956-3a2e4f265fad service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:00.769959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1032/2087] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:00 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 264 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:01.985698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f708c-ac17-432a-b651-9e52e2fa90f1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:01.986164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f708c-ac17-432a-b651-9e52e2fa90f1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:01.986432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781f708c-ac17-432a-b651-9e52e2fa90f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:02.010540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-781f708c-ac17-432a-b651-9e52e2fa90f1 None None] MFA Rules not processed for user `9d7d6f60f4684fbf881a0df657dacc76`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:02.013115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-781f708c-ac17-432a-b651-9e52e2fa90f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:02.019012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1056/2088] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:01 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:06.300868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d362d9-9d02-413e-997f-831edd761be3 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:06.301412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d362d9-9d02-413e-997f-831edd761be3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:06.301412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9d362d9-9d02-413e-997f-831edd761be3 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:06.302824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1033/2089] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:38:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:38:06.312128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a85ae-2505-4fe1-83ee-29e7cbb28bab None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:06.312985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a85ae-2505-4fe1-83ee-29e7cbb28bab None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:06.313272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48a85ae-2505-4fe1-83ee-29e7cbb28bab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:06.337693 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a48a85ae-2505-4fe1-83ee-29e7cbb28bab None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:06.339101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a48a85ae-2505-4fe1-83ee-29e7cbb28bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:06.376526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d362d9-9d02-413e-997f-831edd761be3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:06.380588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e9d362d9-9d02-413e-997f-831edd761be3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:06.442047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:06.466929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1057/2090] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:06.479616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a85ae-2505-4fe1-83ee-29e7cbb28bab None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:06.481192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a48a85ae-2505-4fe1-83ee-29e7cbb28bab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:06.484723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9d362d9-9d02-413e-997f-831edd761be3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:06.492214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:06.493095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:06.493381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:06.493686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] PATH_INFO: `/v3/users/536ab924a5e049bfa8ee1a723d801d7e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:06.494552 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48a85ae-2505-4fe1-83ee-29e7cbb28bab None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:06.494971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=536ab924a5e049bfa8ee1a723d801d7e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:06.496863 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:06.500104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8aaf6a-b154-4b63-8b8f-0e730f456127 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:06.500766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8aaf6a-b154-4b63-8b8f-0e730f456127 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:06.501050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8aaf6a-b154-4b63-8b8f-0e730f456127 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:06.501323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8aaf6a-b154-4b63-8b8f-0e730f456127 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:06.513009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8aaf6a-b154-4b63-8b8f-0e730f456127 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:06.514814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c8aaf6a-b154-4b63-8b8f-0e730f456127 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:06.528983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1058/2091] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:06 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:38:06.557751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536ab924a5e049bfa8ee1a723d801d7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.571074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536ab924a5e049bfa8ee1a723d801d7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.577817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536ab924a5e049bfa8ee1a723d801d7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.585173 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536ab924a5e049bfa8ee1a723d801d7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.585924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b84b6bbf-dbda-4f02-a8da-18099f098c1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536ab924a5e049bfa8ee1a723d801d7e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.591814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1034/2092] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:06 2022] DELETE /identity/v3/users/536ab924a5e049bfa8ee1a723d801d7e => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:38:06.781564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8aaf6a-b154-4b63-8b8f-0e730f456127 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:06.793676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8aaf6a-b154-4b63-8b8f-0e730f456127 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:06.871188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:06.872179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:06.872455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:06.872729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] PATH_INFO: `/v3/projects/7d7a7f079ded432fb6cc03568af9e5aa` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:06.874023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d7a7f079ded432fb6cc03568af9e5aa)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:06.875930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:06.932560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d7a7f079ded432fb6cc03568af9e5aa', 'request_id': 'req-b0165686-d75c-45cd-90d6-891475b43194'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.934508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:DELETE=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:06.941452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d7a7f079ded432fb6cc03568af9e5aa', 'request_id': 'req-b0165686-d75c-45cd-90d6-891475b43194'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.952324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d7a7f079ded432fb6cc03568af9e5aa', 'request_id': 'req-b0165686-d75c-45cd-90d6-891475b43194'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.967753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] The token cache is being invalidate because project 7d7a7f079ded432fb6cc03568af9e5aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:06.968037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.968671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b0165686-d75c-45cd-90d6-891475b43194 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:06.970296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1059/2093] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:06 2022] DELETE /identity/v3/projects/7d7a7f079ded432fb6cc03568af9e5aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:06.975833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646842-4656-4e26-ade8-463d06256049 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:06.976128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646842-4656-4e26-ade8-463d06256049 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:06.976411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae646842-4656-4e26-ade8-463d06256049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:06.994939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ae646842-4656-4e26-ade8-463d06256049 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:06.996128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae646842-4656-4e26-ade8-463d06256049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:07.069892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1035/2094] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:07.083436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10f50-7d1e-47b4-b93d-15ca28d8f759 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.083726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10f50-7d1e-47b4-b93d-15ca28d8f759 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.084001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb10f50-7d1e-47b4-b93d-15ca28d8f759 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.104092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-abb10f50-7d1e-47b4-b93d-15ca28d8f759 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:07.105305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-abb10f50-7d1e-47b4-b93d-15ca28d8f759 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:07.113720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1060/2095] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:07.118582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646842-4656-4e26-ade8-463d06256049 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:07.128424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae646842-4656-4e26-ade8-463d06256049 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:07.132936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:07.133652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.133935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.134211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.134941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:38:07.135248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:07.136859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:07.150789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1036/2096] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:38:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:38:07.155399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10f50-7d1e-47b4-b93d-15ca28d8f759 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:07.165668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb10f50-7d1e-47b4-b93d-15ca28d8f759 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:07.176464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3990e88-e5c3-4db9-a841-00d61d3965b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:07.176464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3990e88-e5c3-4db9-a841-00d61d3965b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.176464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3990e88-e5c3-4db9-a841-00d61d3965b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.176464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3990e88-e5c3-4db9-a841-00d61d3965b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.177674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3990e88-e5c3-4db9-a841-00d61d3965b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:07.177674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3990e88-e5c3-4db9-a841-00d61d3965b0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:07.205236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1061/2097] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:07 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:38:07.209858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:07.219963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab7660d6-2dd0-410d-ab25-cecf3db282c6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:07.264351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:07.285718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83f8f7-115a-414d-9bfa-d28409d7eee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:07.287075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83f8f7-115a-414d-9bfa-d28409d7eee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.287363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83f8f7-115a-414d-9bfa-d28409d7eee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.287638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd83f8f7-115a-414d-9bfa-d28409d7eee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.288348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83f8f7-115a-414d-9bfa-d28409d7eee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:07.290308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd83f8f7-115a-414d-9bfa-d28409d7eee6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:07.311255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1037/2098] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:07 2022] POST /identity/v3/users => generated 287 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:38:07.315451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3990e88-e5c3-4db9-a841-00d61d3965b0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:07.326452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3990e88-e5c3-4db9-a841-00d61d3965b0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:07.331289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf54d02-714d-4687-845e-b0cc6e2311b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:07.331959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54d02-714d-4687-845e-b0cc6e2311b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.332238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54d02-714d-4687-845e-b0cc6e2311b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.332511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf54d02-714d-4687-845e-b0cc6e2311b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.333947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf54d02-714d-4687-845e-b0cc6e2311b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:07.335725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf54d02-714d-4687-845e-b0cc6e2311b4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:07.347689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1062/2099] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:38:07.352663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83f8f7-115a-414d-9bfa-d28409d7eee6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:07.362752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd83f8f7-115a-414d-9bfa-d28409d7eee6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:07.367703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a5859f3-4dbe-4b46-b483-2d2cc991fa78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:07.368364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5859f3-4dbe-4b46-b483-2d2cc991fa78 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.368646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5859f3-4dbe-4b46-b483-2d2cc991fa78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.368921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a5859f3-4dbe-4b46-b483-2d2cc991fa78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.369685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5859f3-4dbe-4b46-b483-2d2cc991fa78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:07.371292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a5859f3-4dbe-4b46-b483-2d2cc991fa78 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:07.381672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1038/2100] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:07.385687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf54d02-714d-4687-845e-b0cc6e2311b4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:07.398169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf54d02-714d-4687-845e-b0cc6e2311b4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:07.406953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:07.407872 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.408150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.408422 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] PATH_INFO: `/v3/projects/11a25ac1593143d9a6fa3eb891ff8bdd/users/70ba6fa009684c46a32561441bafeb0f/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.428583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11a25ac1593143d9a6fa3eb891ff8bdd, user_id=70ba6fa009684c46a32561441bafeb0f, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:07.431282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:07.448381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1063/2101] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:07 2022] PUT /identity/v3/projects/11a25ac1593143d9a6fa3eb891ff8bdd/users/70ba6fa009684c46a32561441bafeb0f/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:07.458990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac2724-7454-4f01-acc8-08356e3f34b6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.459370 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac2724-7454-4f01-acc8-08356e3f34b6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.459654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ac2724-7454-4f01-acc8-08356e3f34b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.487821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-55ac2724-7454-4f01-acc8-08356e3f34b6 None None] MFA Rules not processed for user `70ba6fa009684c46a32561441bafeb0f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:07.489032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-55ac2724-7454-4f01-acc8-08356e3f34b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:07.558044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1039/2102] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:07 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:07.569103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:07.570915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:07.646272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d190d725-951c-4292-b116-e0e62a110677 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:07.652201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5666819-7222-40c0-aa51-fdd46149b81a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:07.652798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5666819-7222-40c0-aa51-fdd46149b81a service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:07.653073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5666819-7222-40c0-aa51-fdd46149b81a service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:07.653638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5666819-7222-40c0-aa51-fdd46149b81a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:07.663005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5666819-7222-40c0-aa51-fdd46149b81a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:07.664605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5666819-7222-40c0-aa51-fdd46149b81a service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:07.674562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1064/2103] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:07 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:38:10.379677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac2724-7454-4f01-acc8-08356e3f34b6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:10.454395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ac2724-7454-4f01-acc8-08356e3f34b6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:10.459827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:10.460842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:10.461222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:10.461595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] PATH_INFO: `/v3/users/70ba6fa009684c46a32561441bafeb0f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:10.462815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] RBAC: Authorizing `identity:delete_user(user_id=70ba6fa009684c46a32561441bafeb0f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:10.465005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:10.529614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70ba6fa009684c46a32561441bafeb0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:10.531495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:10.544199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70ba6fa009684c46a32561441bafeb0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:10.551374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70ba6fa009684c46a32561441bafeb0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:10.562514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70ba6fa009684c46a32561441bafeb0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:10.563228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70ba6fa009684c46a32561441bafeb0f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:10.571538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1040/2104] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:10 2022] DELETE /identity/v3/users/70ba6fa009684c46a32561441bafeb0f => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:10.576315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218f44-69b4-4ea2-9880-e278ead6edbb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:10.576761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218f44-69b4-4ea2-9880-e278ead6edbb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:10.576761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3218f44-69b4-4ea2-9880-e278ead6edbb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:10.596503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a3218f44-69b4-4ea2-9880-e278ead6edbb None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:10.597880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a3218f44-69b4-4ea2-9880-e278ead6edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:10.653575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=94,keystone:INSERT=3,keystone:DELETE=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:10.666938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1065/2105] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:10.673874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:10.675318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:10.736791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e27217dd-51ee-426c-87e1-cb8e2d1a810a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:10.740402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b247773c-478d-4d3c-9537-4b097bbf7948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:10.741048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247773c-478d-4d3c-9537-4b097bbf7948 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:10.741329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247773c-478d-4d3c-9537-4b097bbf7948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:10.741702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b247773c-478d-4d3c-9537-4b097bbf7948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:10.750615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247773c-478d-4d3c-9537-4b097bbf7948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:10.752033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b247773c-478d-4d3c-9537-4b097bbf7948 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:10.761924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1041/2106] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:11.054550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3218f44-69b4-4ea2-9880-e278ead6edbb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.056028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a3218f44-69b4-4ea2-9880-e278ead6edbb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:11.068349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3218f44-69b4-4ea2-9880-e278ead6edbb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.073970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.075067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.075348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.075618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] PATH_INFO: `/v3/projects/11a25ac1593143d9a6fa3eb891ff8bdd` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.076906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11a25ac1593143d9a6fa3eb891ff8bdd)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.079039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.133065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11a25ac1593143d9a6fa3eb891ff8bdd', 'request_id': 'req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:11.139271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11a25ac1593143d9a6fa3eb891ff8bdd', 'request_id': 'req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:11.147870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11a25ac1593143d9a6fa3eb891ff8bdd', 'request_id': 'req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:11.158398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] The token cache is being invalidate because project 11a25ac1593143d9a6fa3eb891ff8bdd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:11.158704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:11.159321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-db5ecc4b-5405-4bd6-8970-bf166ce65bb0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:11.161183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1066/2107] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:11 2022] DELETE /identity/v3/projects/11a25ac1593143d9a6fa3eb891ff8bdd => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:11.166836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b851-cba6-47cb-b919-71673c5e547f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.167156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b851-cba6-47cb-b919-71673c5e547f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.167477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9715b851-cba6-47cb-b919-71673c5e547f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.186263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9715b851-cba6-47cb-b919-71673c5e547f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:11.187475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9715b851-cba6-47cb-b919-71673c5e547f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:11.250405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1042/2108] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:11.259322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0485a-b7c9-4b40-8695-8dea70f3e69d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.259608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0485a-b7c9-4b40-8695-8dea70f3e69d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.259899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb0485a-b7c9-4b40-8695-8dea70f3e69d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.277875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-afb0485a-b7c9-4b40-8695-8dea70f3e69d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:11.279338 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-afb0485a-b7c9-4b40-8695-8dea70f3e69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:11.287574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1067/2109] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:11.292416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715b851-cba6-47cb-b919-71673c5e547f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.302248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9715b851-cba6-47cb-b919-71673c5e547f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.307784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.308441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.308722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.308995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.309764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:38:11.310067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.311660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.323934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1043/2110] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:38:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:38:11.328308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0485a-b7c9-4b40-8695-8dea70f3e69d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.338524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb0485a-b7c9-4b40-8695-8dea70f3e69d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.345088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa848a4c-0e97-43d1-964e-48b0f1119c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.345831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848a4c-0e97-43d1-964e-48b0f1119c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.346109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848a4c-0e97-43d1-964e-48b0f1119c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.346388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa848a4c-0e97-43d1-964e-48b0f1119c57 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.347100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa848a4c-0e97-43d1-964e-48b0f1119c57 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.349052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa848a4c-0e97-43d1-964e-48b0f1119c57 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.377330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1068/2111] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:11 2022] POST /identity/v3/projects => generated 363 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:11.381965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.392105 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251d1e9d-d7ac-4c4b-be45-29d646653cfd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.448461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:11.455474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89fe98-6b52-4aab-98be-9692b4cb18ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.456265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89fe98-6b52-4aab-98be-9692b4cb18ae admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.456761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89fe98-6b52-4aab-98be-9692b4cb18ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.457546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f89fe98-6b52-4aab-98be-9692b4cb18ae admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.458262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89fe98-6b52-4aab-98be-9692b4cb18ae admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.460680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f89fe98-6b52-4aab-98be-9692b4cb18ae admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.482385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1044/2112] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:11 2022] POST /identity/v3/users => generated 282 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:11.487277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa848a4c-0e97-43d1-964e-48b0f1119c57 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.498275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa848a4c-0e97-43d1-964e-48b0f1119c57 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.502774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f93b74-9b4d-4662-bce1-1ccd1ae577c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.503420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f93b74-9b4d-4662-bce1-1ccd1ae577c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.503700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f93b74-9b4d-4662-bce1-1ccd1ae577c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.503970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f93b74-9b4d-4662-bce1-1ccd1ae577c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.504689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f93b74-9b4d-4662-bce1-1ccd1ae577c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.506440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f93b74-9b4d-4662-bce1-1ccd1ae577c5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.516679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1069/2113] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:38:11.520823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89fe98-6b52-4aab-98be-9692b4cb18ae admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.532811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f89fe98-6b52-4aab-98be-9692b4cb18ae admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.538146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2450bf-38b6-473f-ac22-1ca5eec46aa5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.538808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2450bf-38b6-473f-ac22-1ca5eec46aa5 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.539157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2450bf-38b6-473f-ac22-1ca5eec46aa5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.539349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2450bf-38b6-473f-ac22-1ca5eec46aa5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.540067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2450bf-38b6-473f-ac22-1ca5eec46aa5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.541680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2450bf-38b6-473f-ac22-1ca5eec46aa5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.552106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1045/2114] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:11.557385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f93b74-9b4d-4662-bce1-1ccd1ae577c5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.568420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f93b74-9b4d-4662-bce1-1ccd1ae577c5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.573771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81211bfa-78c9-4470-b7a4-39241b19cf34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.574657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81211bfa-78c9-4470-b7a4-39241b19cf34 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.574940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81211bfa-78c9-4470-b7a4-39241b19cf34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.575211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81211bfa-78c9-4470-b7a4-39241b19cf34 admin admin] PATH_INFO: `/v3/projects/4ea9031ff363410fb5cc55e8773ec80f/users/a1a448de3601490f9e3e98d3f0e0c34c/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.590595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81211bfa-78c9-4470-b7a4-39241b19cf34 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4ea9031ff363410fb5cc55e8773ec80f, user_id=a1a448de3601490f9e3e98d3f0e0c34c, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.593979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81211bfa-78c9-4470-b7a4-39241b19cf34 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.611062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1070/2115] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:11 2022] PUT /identity/v3/projects/4ea9031ff363410fb5cc55e8773ec80f/users/a1a448de3601490f9e3e98d3f0e0c34c/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:11.625574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a13a8-3f3b-4496-88a3-efdb4d1a5acd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.626114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a13a8-3f3b-4496-88a3-efdb4d1a5acd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.626906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f9a13a8-3f3b-4496-88a3-efdb4d1a5acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.660555 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3f9a13a8-3f3b-4496-88a3-efdb4d1a5acd None None] MFA Rules not processed for user `a1a448de3601490f9e3e98d3f0e0c34c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:11.661969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3f9a13a8-3f3b-4496-88a3-efdb4d1a5acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:11.732758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1046/2116] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:11 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:11.737406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81211bfa-78c9-4470-b7a4-39241b19cf34 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.810264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81211bfa-78c9-4470-b7a4-39241b19cf34 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.815158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822a3c6-0778-496c-b4c9-5b851fabc7d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.815803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a3c6-0778-496c-b4c9-5b851fabc7d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.816080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a3c6-0778-496c-b4c9-5b851fabc7d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.816350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6822a3c6-0778-496c-b4c9-5b851fabc7d7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.817048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822a3c6-0778-496c-b4c9-5b851fabc7d7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.819011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6822a3c6-0778-496c-b4c9-5b851fabc7d7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.845533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1071/2117] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:11 2022] POST /identity/v3/projects => generated 365 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:38:11.849648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a13a8-3f3b-4496-88a3-efdb4d1a5acd None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.860752 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f9a13a8-3f3b-4496-88a3-efdb4d1a5acd None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.919489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf7a73-d344-4378-bbf6-1d532f96abe5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.920061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7a73-d344-4378-bbf6-1d532f96abe5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.920343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7a73-d344-4378-bbf6-1d532f96abe5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.920611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fedf7a73-d344-4378-bbf6-1d532f96abe5 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.921293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf7a73-d344-4378-bbf6-1d532f96abe5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.923233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fedf7a73-d344-4378-bbf6-1d532f96abe5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.944125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1047/2118] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:11 2022] POST /identity/v3/users => generated 289 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:11.948116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822a3c6-0778-496c-b4c9-5b851fabc7d7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.955692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:11.960432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6822a3c6-0778-496c-b4c9-5b851fabc7d7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:11.966278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2fb96-9d66-4566-abd0-65355fab84db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:11.967153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2fb96-9d66-4566-abd0-65355fab84db admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:11.967605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2fb96-9d66-4566-abd0-65355fab84db admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:11.967938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97d2fb96-9d66-4566-abd0-65355fab84db admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:11.968852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2fb96-9d66-4566-abd0-65355fab84db admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:11.970505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97d2fb96-9d66-4566-abd0-65355fab84db admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:11.982640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1072/2119] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:11 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:11.987198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf7a73-d344-4378-bbf6-1d532f96abe5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:11.997827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fedf7a73-d344-4378-bbf6-1d532f96abe5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:12.002308 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593416c-62d9-41f2-bb18-ceb1d66655ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:12.003154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593416c-62d9-41f2-bb18-ceb1d66655ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:12.003428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593416c-62d9-41f2-bb18-ceb1d66655ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:12.003695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a593416c-62d9-41f2-bb18-ceb1d66655ec admin admin] PATH_INFO: `/v3/projects/9b38b3001eec45a3b3516cc97eda644a/users/2fbd3b590d834c18b8985b416478996b/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:12.018176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593416c-62d9-41f2-bb18-ceb1d66655ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b38b3001eec45a3b3516cc97eda644a, user_id=2fbd3b590d834c18b8985b416478996b, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:12.021239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a593416c-62d9-41f2-bb18-ceb1d66655ec admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:12.035047 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1048/2120] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:11 2022] PUT /identity/v3/projects/9b38b3001eec45a3b3516cc97eda644a/users/2fbd3b590d834c18b8985b416478996b/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:38:12.039508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2fb96-9d66-4566-abd0-65355fab84db admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:12.052350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97d2fb96-9d66-4566-abd0-65355fab84db admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:12.110925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cae75c9-5e9f-4eb9-aee8-a69d4dab7802 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:12.111597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae75c9-5e9f-4eb9-aee8-a69d4dab7802 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:12.111875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae75c9-5e9f-4eb9-aee8-a69d4dab7802 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:12.112212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cae75c9-5e9f-4eb9-aee8-a69d4dab7802 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:12.112939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae75c9-5e9f-4eb9-aee8-a69d4dab7802 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:12.114574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cae75c9-5e9f-4eb9-aee8-a69d4dab7802 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:12.124591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1073/2121] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:12.128920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593416c-62d9-41f2-bb18-ceb1d66655ec admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:12.138973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a593416c-62d9-41f2-bb18-ceb1d66655ec admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:12.143950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:12.144828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:12.145109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:12.145380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] PATH_INFO: `/v3/projects/9b38b3001eec45a3b3516cc97eda644a/users/2fbd3b590d834c18b8985b416478996b/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:12.147876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b38b3001eec45a3b3516cc97eda644a, user_id=2fbd3b590d834c18b8985b416478996b, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:12.150900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:12.162221 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1049/2122] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:12 2022] PUT /identity/v3/projects/9b38b3001eec45a3b3516cc97eda644a/users/2fbd3b590d834c18b8985b416478996b/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:12.173248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122255a-4fbf-4301-ae35-cc2e9f4ea364 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:12.173477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122255a-4fbf-4301-ae35-cc2e9f4ea364 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:12.173745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a122255a-4fbf-4301-ae35-cc2e9f4ea364 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:12.200963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a122255a-4fbf-4301-ae35-cc2e9f4ea364 None None] MFA Rules not processed for user `2fbd3b590d834c18b8985b416478996b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:12.202240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a122255a-4fbf-4301-ae35-cc2e9f4ea364 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:12.272767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1074/2123] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:12 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:12.285141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:12.286913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:12.307868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:12.349551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96246466-2cb5-4c5a-a8a7-43b82721dd3d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:12.353155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4e4bf89-da57-4b5b-a01c-37904b926577 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:12.353821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4bf89-da57-4b5b-a01c-37904b926577 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:12.354136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4bf89-da57-4b5b-a01c-37904b926577 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:12.354413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4e4bf89-da57-4b5b-a01c-37904b926577 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:12.363556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4bf89-da57-4b5b-a01c-37904b926577 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:12.364996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4e4bf89-da57-4b5b-a01c-37904b926577 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:12.374532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1050/2124] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:12 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:12.820418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122255a-4fbf-4301-ae35-cc2e9f4ea364 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:12.892541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a122255a-4fbf-4301-ae35-cc2e9f4ea364 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:12.897064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:12.898027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:12.898311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:12.898577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] PATH_INFO: `/v3/users/a1a448de3601490f9e3e98d3f0e0c34c` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:12.899767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1a448de3601490f9e3e98d3f0e0c34c)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:12.901704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:12.918943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:12.952435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1a448de3601490f9e3e98d3f0e0c34c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:12.959841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1a448de3601490f9e3e98d3f0e0c34c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:12.966321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1a448de3601490f9e3e98d3f0e0c34c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:12.978748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1a448de3601490f9e3e98d3f0e0c34c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:12.979440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1a448de3601490f9e3e98d3f0e0c34c'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:12.985986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1075/2125] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:12 2022] DELETE /identity/v3/users/a1a448de3601490f9e3e98d3f0e0c34c => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:12.991208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc027a2-0cf3-49a2-a618-7d87a48c52cc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:12.991691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc027a2-0cf3-49a2-a618-7d87a48c52cc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:12.991952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dc027a2-0cf3-49a2-a618-7d87a48c52cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:13.009243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8dc027a2-0cf3-49a2-a618-7d87a48c52cc None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:13.010515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8dc027a2-0cf3-49a2-a618-7d87a48c52cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:13.070951 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1051/2126] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:13.080620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:13.082057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:13.140337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-820cb7f4-1204-440b-abb0-2272b85ca06e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:13.143946 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32723389-9769-4405-bb4c-4e225631840a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:13.144564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723389-9769-4405-bb4c-4e225631840a service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:13.144843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723389-9769-4405-bb4c-4e225631840a service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:13.145114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32723389-9769-4405-bb4c-4e225631840a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:13.154300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32723389-9769-4405-bb4c-4e225631840a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:13.155729 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32723389-9769-4405-bb4c-4e225631840a service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:13.166117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1076/2127] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:13.445458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc027a2-0cf3-49a2-a618-7d87a48c52cc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:13.447594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8dc027a2-0cf3-49a2-a618-7d87a48c52cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:13.466259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dc027a2-0cf3-49a2-a618-7d87a48c52cc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:13.471111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:13.472150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:13.472497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:13.474452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] PATH_INFO: `/v3/projects/4ea9031ff363410fb5cc55e8773ec80f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:13.480982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] RBAC: Authorizing `identity:delete_project(project_id=4ea9031ff363410fb5cc55e8773ec80f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:13.482969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:13.532950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4ea9031ff363410fb5cc55e8773ec80f', 'request_id': 'req-07e2874b-a625-435b-a62c-0cee9c6ea39a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.543234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4ea9031ff363410fb5cc55e8773ec80f', 'request_id': 'req-07e2874b-a625-435b-a62c-0cee9c6ea39a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.550526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4ea9031ff363410fb5cc55e8773ec80f', 'request_id': 'req-07e2874b-a625-435b-a62c-0cee9c6ea39a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.562234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] The token cache is being invalidate because project 4ea9031ff363410fb5cc55e8773ec80f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:13.562514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.563204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.564928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1052/2128] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:13 2022] DELETE /identity/v3/projects/4ea9031ff363410fb5cc55e8773ec80f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:13.569520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32723389-9769-4405-bb4c-4e225631840a service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:13.579079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32723389-9769-4405-bb4c-4e225631840a service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:13.640466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:13.641335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:13.641675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:13.641947 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] PATH_INFO: `/v3/users/2fbd3b590d834c18b8985b416478996b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:13.643110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fbd3b590d834c18b8985b416478996b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:13.645018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:13.686631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=14,keystone:SELECT=85,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:13.694218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fbd3b590d834c18b8985b416478996b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.701662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fbd3b590d834c18b8985b416478996b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.708961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fbd3b590d834c18b8985b416478996b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.724185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fbd3b590d834c18b8985b416478996b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.724887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3b4dd873-456c-46f0-b625-7e6d54ac19c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fbd3b590d834c18b8985b416478996b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:13.732262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1077/2129] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:13 2022] DELETE /identity/v3/users/2fbd3b590d834c18b8985b416478996b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:14.098658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.101388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:14.114531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e2874b-a625-435b-a62c-0cee9c6ea39a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.159980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:14.176388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.177251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.177576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.177856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] PATH_INFO: `/v3/projects/9b38b3001eec45a3b3516cc97eda644a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.179170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b38b3001eec45a3b3516cc97eda644a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.181114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:14.230320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b38b3001eec45a3b3516cc97eda644a', 'request_id': 'req-9fad828b-5d61-4d9b-bcf2-7c836e192726'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:14.236468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b38b3001eec45a3b3516cc97eda644a', 'request_id': 'req-9fad828b-5d61-4d9b-bcf2-7c836e192726'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:14.244180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b38b3001eec45a3b3516cc97eda644a', 'request_id': 'req-9fad828b-5d61-4d9b-bcf2-7c836e192726'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:14.255512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] The token cache is being invalidate because project 9b38b3001eec45a3b3516cc97eda644a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:14.255830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:14.256623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9fad828b-5d61-4d9b-bcf2-7c836e192726 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:14.258640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1053/2130] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:14 2022] DELETE /identity/v3/projects/9b38b3001eec45a3b3516cc97eda644a => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:14.263796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4014ed0-2f7d-4f5d-987d-9149112d8f9d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.264280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4014ed0-2f7d-4f5d-987d-9149112d8f9d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.264388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4014ed0-2f7d-4f5d-987d-9149112d8f9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.283448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d4014ed0-2f7d-4f5d-987d-9149112d8f9d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:14.284672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d4014ed0-2f7d-4f5d-987d-9149112d8f9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:14.346416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1078/2131] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:14.355377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3fa76-5ede-4994-a9ed-099aa38afe3b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.355662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3fa76-5ede-4994-a9ed-099aa38afe3b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.355935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de3fa76-5ede-4994-a9ed-099aa38afe3b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.373868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9de3fa76-5ede-4994-a9ed-099aa38afe3b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:14.375076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9de3fa76-5ede-4994-a9ed-099aa38afe3b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:14.383258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1054/2132] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:14.387524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4014ed0-2f7d-4f5d-987d-9149112d8f9d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.398177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4014ed0-2f7d-4f5d-987d-9149112d8f9d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.402732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.403632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.403914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.404186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.404911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:38:14.405215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.406871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:14.419502 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1079/2133] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:38:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:38:14.423678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3fa76-5ede-4994-a9ed-099aa38afe3b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.433181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de3fa76-5ede-4994-a9ed-099aa38afe3b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.437792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e506-976c-4e5c-8a5f-791a830a5704 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.438431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e506-976c-4e5c-8a5f-791a830a5704 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.438709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e506-976c-4e5c-8a5f-791a830a5704 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.438981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e566e506-976c-4e5c-8a5f-791a830a5704 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.439663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566e506-976c-4e5c-8a5f-791a830a5704 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.441849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e566e506-976c-4e5c-8a5f-791a830a5704 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:14.472742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1055/2134] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:14 2022] POST /identity/v3/projects => generated 387 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:14.476988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.487315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed236d28-e556-45e1-9c01-7045c205c941 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.549974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665d058-1cd7-48a1-8e33-7e6aefcc3b0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.550647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665d058-1cd7-48a1-8e33-7e6aefcc3b0d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.550929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665d058-1cd7-48a1-8e33-7e6aefcc3b0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.551224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b665d058-1cd7-48a1-8e33-7e6aefcc3b0d admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.551887 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665d058-1cd7-48a1-8e33-7e6aefcc3b0d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.553969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b665d058-1cd7-48a1-8e33-7e6aefcc3b0d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:14.574645 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1080/2135] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:14 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:14.578688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e506-976c-4e5c-8a5f-791a830a5704 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.590579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e566e506-976c-4e5c-8a5f-791a830a5704 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.595114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58ad8d-ebf3-43d1-a5d1-eae1f9f20741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.595763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ad8d-ebf3-43d1-a5d1-eae1f9f20741 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.596040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ad8d-ebf3-43d1-a5d1-eae1f9f20741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.596311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe58ad8d-ebf3-43d1-a5d1-eae1f9f20741 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.597107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58ad8d-ebf3-43d1-a5d1-eae1f9f20741 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.598691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe58ad8d-ebf3-43d1-a5d1-eae1f9f20741 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:14.609472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1056/2136] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:14.614264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665d058-1cd7-48a1-8e33-7e6aefcc3b0d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.624515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b665d058-1cd7-48a1-8e33-7e6aefcc3b0d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.629503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00beda-58fd-44f4-953f-5ed14004798b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.630166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00beda-58fd-44f4-953f-5ed14004798b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.630451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00beda-58fd-44f4-953f-5ed14004798b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.630726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00beda-58fd-44f4-953f-5ed14004798b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.632307 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00beda-58fd-44f4-953f-5ed14004798b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.634039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00beda-58fd-44f4-953f-5ed14004798b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:14.644672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1081/2137] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:14 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:14.649602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58ad8d-ebf3-43d1-a5d1-eae1f9f20741 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.662061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe58ad8d-ebf3-43d1-a5d1-eae1f9f20741 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.666876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4452-0740-41ac-bca3-52a91757432a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.667866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4452-0740-41ac-bca3-52a91757432a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.668172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4452-0740-41ac-bca3-52a91757432a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.668459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75e4452-0740-41ac-bca3-52a91757432a admin admin] PATH_INFO: `/v3/projects/c593d77d7c4c45ae8d8c23b07da32dc6/users/29e91b9338584ace9e85aa38009606d1/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.683278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4452-0740-41ac-bca3-52a91757432a admin admin] RBAC: Authorizing `identity:create_grant(project_id=c593d77d7c4c45ae8d8c23b07da32dc6, user_id=29e91b9338584ace9e85aa38009606d1, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.685941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75e4452-0740-41ac-bca3-52a91757432a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:14.699574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1057/2138] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:14 2022] PUT /identity/v3/projects/c593d77d7c4c45ae8d8c23b07da32dc6/users/29e91b9338584ace9e85aa38009606d1/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:14.712483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488f814-3621-40d9-bf4a-4c84dfbfda60 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.712896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488f814-3621-40d9-bf4a-4c84dfbfda60 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.713276 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8488f814-3621-40d9-bf4a-4c84dfbfda60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.739069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8488f814-3621-40d9-bf4a-4c84dfbfda60 None None] MFA Rules not processed for user `29e91b9338584ace9e85aa38009606d1`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:14.740273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8488f814-3621-40d9-bf4a-4c84dfbfda60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:14.749276 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:14.808985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1082/2139] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:14 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:14.813119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4452-0740-41ac-bca3-52a91757432a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.879957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75e4452-0740-41ac-bca3-52a91757432a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.885019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44508-9757-4dfc-bc25-e9ef08d337a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.885789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44508-9757-4dfc-bc25-e9ef08d337a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.886162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44508-9757-4dfc-bc25-e9ef08d337a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.886517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d44508-9757-4dfc-bc25-e9ef08d337a2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.887349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d44508-9757-4dfc-bc25-e9ef08d337a2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.889582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d44508-9757-4dfc-bc25-e9ef08d337a2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:14.904712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:14.920058 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1058/2140] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:14 2022] POST /identity/v3/projects => generated 387 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:14.924073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488f814-3621-40d9-bf4a-4c84dfbfda60 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:14.934983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8488f814-3621-40d9-bf4a-4c84dfbfda60 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:14.992444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a539d7-432e-40ee-b576-a1691de25960 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:14.993112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a539d7-432e-40ee-b576-a1691de25960 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:14.993393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a539d7-432e-40ee-b576-a1691de25960 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:14.993701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5a539d7-432e-40ee-b576-a1691de25960 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:14.994453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a539d7-432e-40ee-b576-a1691de25960 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:14.996390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5a539d7-432e-40ee-b576-a1691de25960 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:15.015612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1083/2141] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:14 2022] POST /identity/v3/users => generated 300 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:38:15.019624 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44508-9757-4dfc-bc25-e9ef08d337a2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:15.031436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d44508-9757-4dfc-bc25-e9ef08d337a2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:15.036329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4db28-f4eb-4287-83a9-573fac0c0ee1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:15.037005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4db28-f4eb-4287-83a9-573fac0c0ee1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:15.037358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4db28-f4eb-4287-83a9-573fac0c0ee1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:15.038181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c4db28-f4eb-4287-83a9-573fac0c0ee1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:15.038934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4db28-f4eb-4287-83a9-573fac0c0ee1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:15.040553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c4db28-f4eb-4287-83a9-573fac0c0ee1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:15.052638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1059/2142] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:15.056879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a539d7-432e-40ee-b576-a1691de25960 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:15.067377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5a539d7-432e-40ee-b576-a1691de25960 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:15.072139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad9193-d5b0-4f29-9615-55e55da5be89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:15.073031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad9193-d5b0-4f29-9615-55e55da5be89 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:15.073310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad9193-d5b0-4f29-9615-55e55da5be89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:15.073618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cad9193-d5b0-4f29-9615-55e55da5be89 admin admin] PATH_INFO: `/v3/projects/21371b31bfdd42449ec323f6a47215dd/users/d3a436563c2643bf8c91d3f805aff132/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:15.089219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad9193-d5b0-4f29-9615-55e55da5be89 admin admin] RBAC: Authorizing `identity:create_grant(project_id=21371b31bfdd42449ec323f6a47215dd, user_id=d3a436563c2643bf8c91d3f805aff132, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:15.091948 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cad9193-d5b0-4f29-9615-55e55da5be89 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:15.106058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1084/2143] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:15 2022] PUT /identity/v3/projects/21371b31bfdd42449ec323f6a47215dd/users/d3a436563c2643bf8c91d3f805aff132/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:15.109904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4db28-f4eb-4287-83a9-573fac0c0ee1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:15.120100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c4db28-f4eb-4287-83a9-573fac0c0ee1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:15.186404 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfca7a51-7715-4465-8284-fcae63f54c39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:15.187066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7a51-7715-4465-8284-fcae63f54c39 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:15.187348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7a51-7715-4465-8284-fcae63f54c39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:15.187760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfca7a51-7715-4465-8284-fcae63f54c39 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:15.188488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca7a51-7715-4465-8284-fcae63f54c39 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:15.190172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfca7a51-7715-4465-8284-fcae63f54c39 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:15.203507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1060/2144] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:15 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:15.204748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad9193-d5b0-4f29-9615-55e55da5be89 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:15.216634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cad9193-d5b0-4f29-9615-55e55da5be89 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:15.221230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:15.222131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:15.222405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:15.222671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] PATH_INFO: `/v3/projects/21371b31bfdd42449ec323f6a47215dd/users/d3a436563c2643bf8c91d3f805aff132/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:15.224617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] RBAC: Authorizing `identity:create_grant(project_id=21371b31bfdd42449ec323f6a47215dd, user_id=d3a436563c2643bf8c91d3f805aff132, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:15.227473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:15.237869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1085/2145] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:15 2022] PUT /identity/v3/projects/21371b31bfdd42449ec323f6a47215dd/users/d3a436563c2643bf8c91d3f805aff132/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:15.248299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72dc33-1627-4756-b168-8219ccc8fcea None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:15.248727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72dc33-1627-4756-b168-8219ccc8fcea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:15.249218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f72dc33-1627-4756-b168-8219ccc8fcea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:15.278461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1f72dc33-1627-4756-b168-8219ccc8fcea None None] MFA Rules not processed for user `d3a436563c2643bf8c91d3f805aff132`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:15.279714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1f72dc33-1627-4756-b168-8219ccc8fcea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:15.349359 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1061/2146] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:15 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:38:15.361049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:15.362851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:15.427600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebd1102-b540-4a1d-9d17-b4f66736b47e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:15.431720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-954970f6-26ad-4215-8b72-76931cb07e21 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:15.432374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954970f6-26ad-4215-8b72-76931cb07e21 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:15.432654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954970f6-26ad-4215-8b72-76931cb07e21 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:15.432927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-954970f6-26ad-4215-8b72-76931cb07e21 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:15.442690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954970f6-26ad-4215-8b72-76931cb07e21 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:15.445054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-954970f6-26ad-4215-8b72-76931cb07e21 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:15.454543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1086/2147] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:15 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:16.020746 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72dc33-1627-4756-b168-8219ccc8fcea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:16.083762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f72dc33-1627-4756-b168-8219ccc8fcea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:16.089540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:16.090428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:16.090702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:16.091022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] PATH_INFO: `/v3/users/29e91b9338584ace9e85aa38009606d1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:16.092449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=29e91b9338584ace9e85aa38009606d1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:16.094649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:16.101837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:16.144655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '29e91b9338584ace9e85aa38009606d1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.156915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '29e91b9338584ace9e85aa38009606d1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.164266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '29e91b9338584ace9e85aa38009606d1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.171433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '29e91b9338584ace9e85aa38009606d1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.172106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '29e91b9338584ace9e85aa38009606d1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.179233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1062/2148] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:16 2022] DELETE /identity/v3/users/29e91b9338584ace9e85aa38009606d1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:16.183845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843a07-fbf6-4ad5-8976-bf12acdf2124 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:16.184407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843a07-fbf6-4ad5-8976-bf12acdf2124 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:16.184750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22843a07-fbf6-4ad5-8976-bf12acdf2124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:16.196672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:16.202695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-22843a07-fbf6-4ad5-8976-bf12acdf2124 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:16.204395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-22843a07-fbf6-4ad5-8976-bf12acdf2124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:16.267508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1087/2149] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:16.278060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:16.279779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:16.344060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2ab8d4-10ed-4c71-a711-1c452db30ef1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:16.347768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5f165-ee26-482b-b946-2c9a87d6830c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:16.348417 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5f165-ee26-482b-b946-2c9a87d6830c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:16.348701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5f165-ee26-482b-b946-2c9a87d6830c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:16.348981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa5f165-ee26-482b-b946-2c9a87d6830c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:16.360884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5f165-ee26-482b-b946-2c9a87d6830c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:16.362379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa5f165-ee26-482b-b946-2c9a87d6830c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:16.372840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1063/2150] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:16.697572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22843a07-fbf6-4ad5-8976-bf12acdf2124 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:16.699114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-22843a07-fbf6-4ad5-8976-bf12acdf2124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:16.714098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22843a07-fbf6-4ad5-8976-bf12acdf2124 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:16.718526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:16.719379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:16.720411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:16.720732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] PATH_INFO: `/v3/projects/c593d77d7c4c45ae8d8c23b07da32dc6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:16.722026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c593d77d7c4c45ae8d8c23b07da32dc6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:16.724019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:16.776256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c593d77d7c4c45ae8d8c23b07da32dc6', 'request_id': 'req-0b693b7c-8383-4bda-9cac-74590c939bf2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.782731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c593d77d7c4c45ae8d8c23b07da32dc6', 'request_id': 'req-0b693b7c-8383-4bda-9cac-74590c939bf2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.790345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c593d77d7c4c45ae8d8c23b07da32dc6', 'request_id': 'req-0b693b7c-8383-4bda-9cac-74590c939bf2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.801310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] The token cache is being invalidate because project c593d77d7c4c45ae8d8c23b07da32dc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:16.801580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.802254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.804161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1088/2151] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:16 2022] DELETE /identity/v3/projects/c593d77d7c4c45ae8d8c23b07da32dc6 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:16.808286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5f165-ee26-482b-b946-2c9a87d6830c service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:16.820823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa5f165-ee26-482b-b946-2c9a87d6830c service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:16.888121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:16.889238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:16.889604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:16.889883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] PATH_INFO: `/v3/users/d3a436563c2643bf8c91d3f805aff132` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:16.891119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3a436563c2643bf8c91d3f805aff132)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:16.893377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:16.948400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:16.965005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3a436563c2643bf8c91d3f805aff132'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.978140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3a436563c2643bf8c91d3f805aff132'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.987743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3a436563c2643bf8c91d3f805aff132'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.998353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3a436563c2643bf8c91d3f805aff132'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:16.999088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5e1b7d3c-d91b-4ff2-a4d5-72c8bc4f8d43 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3a436563c2643bf8c91d3f805aff132'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:17.006911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1064/2152] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:16 2022] DELETE /identity/v3/users/d3a436563c2643bf8c91d3f805aff132 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:38:17.308571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:17.310136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:17.324027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b693b7c-8383-4bda-9cac-74590c939bf2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:17.392096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:17.392995 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.393278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.393584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] PATH_INFO: `/v3/projects/21371b31bfdd42449ec323f6a47215dd` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.394783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=21371b31bfdd42449ec323f6a47215dd)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:17.397248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:17.434373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:17.448399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '21371b31bfdd42449ec323f6a47215dd', 'request_id': 'req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:17.454621 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '21371b31bfdd42449ec323f6a47215dd', 'request_id': 'req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:17.464582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '21371b31bfdd42449ec323f6a47215dd', 'request_id': 'req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:17.475618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] The token cache is being invalidate because project 21371b31bfdd42449ec323f6a47215dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:17.475900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:17.476517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0f7e4949-e6d2-4aa6-b164-910b8dfe04c2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:17.478125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1089/2153] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:17 2022] DELETE /identity/v3/projects/21371b31bfdd42449ec323f6a47215dd => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:17.483105 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c47d1-73da-49b8-89e6-0c51115059b6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.483609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c47d1-73da-49b8-89e6-0c51115059b6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.483609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285c47d1-73da-49b8-89e6-0c51115059b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.503834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-285c47d1-73da-49b8-89e6-0c51115059b6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:17.505236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-285c47d1-73da-49b8-89e6-0c51115059b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:17.570401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1065/2154] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:17.578232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f44e3-d452-46a7-8c52-06f4eb4772d1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.578736 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f44e3-d452-46a7-8c52-06f4eb4772d1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.579019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba9f44e3-d452-46a7-8c52-06f4eb4772d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.603646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ba9f44e3-d452-46a7-8c52-06f4eb4772d1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:17.604867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ba9f44e3-d452-46a7-8c52-06f4eb4772d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:17.613568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1090/2155] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:17.618374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c47d1-73da-49b8-89e6-0c51115059b6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:17.630181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285c47d1-73da-49b8-89e6-0c51115059b6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:17.636339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:17.637016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.637301 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.637605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.638393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:38:17.638716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:17.640393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:17.658440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1066/2156] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:38:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:38:17.659801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f44e3-d452-46a7-8c52-06f4eb4772d1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:17.671059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba9f44e3-d452-46a7-8c52-06f4eb4772d1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:17.675858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336df1d-e143-417e-ae6e-dba7a9c0443a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:17.676507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336df1d-e143-417e-ae6e-dba7a9c0443a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.676903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336df1d-e143-417e-ae6e-dba7a9c0443a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.677179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0336df1d-e143-417e-ae6e-dba7a9c0443a admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.677997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336df1d-e143-417e-ae6e-dba7a9c0443a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:17.680449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0336df1d-e143-417e-ae6e-dba7a9c0443a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:17.708042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1091/2157] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:17 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:17.712577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:17.723659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-607d9388-5ad7-4529-a37b-5513e3a83cd7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:17.783422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4bed-cf4b-4b87-af59-46fe10072762 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:17.784089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4bed-cf4b-4b87-af59-46fe10072762 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.784375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4bed-cf4b-4b87-af59-46fe10072762 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.784654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97db4bed-cf4b-4b87-af59-46fe10072762 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.785350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db4bed-cf4b-4b87-af59-46fe10072762 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:17.787350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97db4bed-cf4b-4b87-af59-46fe10072762 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:17.807588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1067/2158] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:17 2022] POST /identity/v3/users => generated 288 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:38:17.813097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336df1d-e143-417e-ae6e-dba7a9c0443a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:17.824721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0336df1d-e143-417e-ae6e-dba7a9c0443a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:17.829270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d3996-8d60-4d0e-b950-5f9f3ffd6f14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:17.829963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3996-8d60-4d0e-b950-5f9f3ffd6f14 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.830238 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3996-8d60-4d0e-b950-5f9f3ffd6f14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.830508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646d3996-8d60-4d0e-b950-5f9f3ffd6f14 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.831229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d3996-8d60-4d0e-b950-5f9f3ffd6f14 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:17.832815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646d3996-8d60-4d0e-b950-5f9f3ffd6f14 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:17.844511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1092/2159] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:17.848476 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4bed-cf4b-4b87-af59-46fe10072762 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:17.858412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97db4bed-cf4b-4b87-af59-46fe10072762 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:17.864832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86bee3e5-856f-4826-9b0b-9f4ade7577a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:17.866046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee3e5-856f-4826-9b0b-9f4ade7577a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.866324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee3e5-856f-4826-9b0b-9f4ade7577a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.866577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86bee3e5-856f-4826-9b0b-9f4ade7577a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.867299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee3e5-856f-4826-9b0b-9f4ade7577a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:17.868878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86bee3e5-856f-4826-9b0b-9f4ade7577a0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:17.878648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1068/2160] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:17 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:17.883390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d3996-8d60-4d0e-b950-5f9f3ffd6f14 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:17.894217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646d3996-8d60-4d0e-b950-5f9f3ffd6f14 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:17.899541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f5b17-0c25-4919-a132-40177965c8af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:17.900434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f5b17-0c25-4919-a132-40177965c8af admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.900709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f5b17-0c25-4919-a132-40177965c8af admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.900978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44f5b17-0c25-4919-a132-40177965c8af admin admin] PATH_INFO: `/v3/projects/0e7556f80c594a858a7f5c9977863f8a/users/c45b6ea0f6f0446890d896c6e1274396/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.916767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f5b17-0c25-4919-a132-40177965c8af admin admin] RBAC: Authorizing `identity:create_grant(project_id=0e7556f80c594a858a7f5c9977863f8a, user_id=c45b6ea0f6f0446890d896c6e1274396, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:17.919454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44f5b17-0c25-4919-a132-40177965c8af admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:17.933589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1093/2161] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:17 2022] PUT /identity/v3/projects/0e7556f80c594a858a7f5c9977863f8a/users/c45b6ea0f6f0446890d896c6e1274396/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:17.945223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9982d-14a4-45d6-bc9e-3b81d437ac69 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:17.945795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9982d-14a4-45d6-bc9e-3b81d437ac69 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:17.946510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c9982d-14a4-45d6-bc9e-3b81d437ac69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:17.976102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-86c9982d-14a4-45d6-bc9e-3b81d437ac69 None None] MFA Rules not processed for user `c45b6ea0f6f0446890d896c6e1274396`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:17.977130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:17.978247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-86c9982d-14a4-45d6-bc9e-3b81d437ac69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:18.044640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1069/2162] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:17 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:18.049837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f5b17-0c25-4919-a132-40177965c8af admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.128665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44f5b17-0c25-4919-a132-40177965c8af admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.134915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698cb7-a55d-4cff-8451-e23b09254472 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.135573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698cb7-a55d-4cff-8451-e23b09254472 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.135853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698cb7-a55d-4cff-8451-e23b09254472 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.136125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a698cb7-a55d-4cff-8451-e23b09254472 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.136815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698cb7-a55d-4cff-8451-e23b09254472 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.138752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a698cb7-a55d-4cff-8451-e23b09254472 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.164668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1094/2163] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:18 2022] POST /identity/v3/projects => generated 377 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:18.168699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9982d-14a4-45d6-bc9e-3b81d437ac69 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.180798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c9982d-14a4-45d6-bc9e-3b81d437ac69 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.236677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58379e06-ec06-4cdc-9140-1dc428fca4f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.237335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58379e06-ec06-4cdc-9140-1dc428fca4f4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.237643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58379e06-ec06-4cdc-9140-1dc428fca4f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.237918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58379e06-ec06-4cdc-9140-1dc428fca4f4 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.238605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58379e06-ec06-4cdc-9140-1dc428fca4f4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.241264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58379e06-ec06-4cdc-9140-1dc428fca4f4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.260828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1070/2164] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:18 2022] POST /identity/v3/users => generated 289 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:18.265070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698cb7-a55d-4cff-8451-e23b09254472 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.275530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a698cb7-a55d-4cff-8451-e23b09254472 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.280626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb20f1-658c-4485-90ba-83bce578200d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.281323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb20f1-658c-4485-90ba-83bce578200d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.281644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb20f1-658c-4485-90ba-83bce578200d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.281923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ceb20f1-658c-4485-90ba-83bce578200d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.282697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb20f1-658c-4485-90ba-83bce578200d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.284367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ceb20f1-658c-4485-90ba-83bce578200d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.296348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1095/2165] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:18.300238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58379e06-ec06-4cdc-9140-1dc428fca4f4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.311007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58379e06-ec06-4cdc-9140-1dc428fca4f4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.315623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8cf366-cee4-4321-8b9b-1300f27eb422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.316279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cf366-cee4-4321-8b9b-1300f27eb422 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.316563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cf366-cee4-4321-8b9b-1300f27eb422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.316841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8cf366-cee4-4321-8b9b-1300f27eb422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.317595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cf366-cee4-4321-8b9b-1300f27eb422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.319213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8cf366-cee4-4321-8b9b-1300f27eb422 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.328985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1071/2166] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:18.332988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb20f1-658c-4485-90ba-83bce578200d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.343008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ceb20f1-658c-4485-90ba-83bce578200d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.347573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82156058-cc54-4420-b426-1df41c176ddf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.348435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82156058-cc54-4420-b426-1df41c176ddf admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.348713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82156058-cc54-4420-b426-1df41c176ddf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.348983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82156058-cc54-4420-b426-1df41c176ddf admin admin] PATH_INFO: `/v3/projects/bd54ca5461004a9a883dac912f5d205b/users/8d3ef5be9915454a8c185e04695b12ef/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.364839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82156058-cc54-4420-b426-1df41c176ddf admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd54ca5461004a9a883dac912f5d205b, user_id=8d3ef5be9915454a8c185e04695b12ef, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.368190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82156058-cc54-4420-b426-1df41c176ddf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.380737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1096/2167] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:18 2022] PUT /identity/v3/projects/bd54ca5461004a9a883dac912f5d205b/users/8d3ef5be9915454a8c185e04695b12ef/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:18.391027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ba4c8-df2d-4194-90e5-986e42fa6026 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.391321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ba4c8-df2d-4194-90e5-986e42fa6026 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.391604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-998ba4c8-df2d-4194-90e5-986e42fa6026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.419820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-998ba4c8-df2d-4194-90e5-986e42fa6026 None None] MFA Rules not processed for user `8d3ef5be9915454a8c185e04695b12ef`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:18.421030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-998ba4c8-df2d-4194-90e5-986e42fa6026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:18.487965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1072/2168] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:18 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:18.492434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82156058-cc54-4420-b426-1df41c176ddf admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.501309 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:18.557692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82156058-cc54-4420-b426-1df41c176ddf admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.562323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bba69-777d-4254-a811-b36d623e237f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.562973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bba69-777d-4254-a811-b36d623e237f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.563247 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bba69-777d-4254-a811-b36d623e237f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.563517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1bba69-777d-4254-a811-b36d623e237f admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.564214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bba69-777d-4254-a811-b36d623e237f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.566142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1bba69-777d-4254-a811-b36d623e237f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.591114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1097/2169] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:18 2022] POST /identity/v3/projects => generated 377 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:18.595242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ba4c8-df2d-4194-90e5-986e42fa6026 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.606455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-998ba4c8-df2d-4194-90e5-986e42fa6026 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.614364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:18.670427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f069b1-8361-44d1-afc5-986fdb2441fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.671197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f069b1-8361-44d1-afc5-986fdb2441fe admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.671588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f069b1-8361-44d1-afc5-986fdb2441fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.672036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14f069b1-8361-44d1-afc5-986fdb2441fe admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.672844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f069b1-8361-44d1-afc5-986fdb2441fe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.675011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14f069b1-8361-44d1-afc5-986fdb2441fe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.697821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1073/2170] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:18 2022] POST /identity/v3/users => generated 295 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:18.701653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bba69-777d-4254-a811-b36d623e237f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.714804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1bba69-777d-4254-a811-b36d623e237f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.719576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f28db0-1971-4e7e-a1b9-1f6dc75c64d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.720496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f28db0-1971-4e7e-a1b9-1f6dc75c64d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.720708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f28db0-1971-4e7e-a1b9-1f6dc75c64d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.721046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f28db0-1971-4e7e-a1b9-1f6dc75c64d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.721870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f28db0-1971-4e7e-a1b9-1f6dc75c64d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.723542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f28db0-1971-4e7e-a1b9-1f6dc75c64d2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.735559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1098/2171] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:18.739473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f069b1-8361-44d1-afc5-986fdb2441fe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.753643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14f069b1-8361-44d1-afc5-986fdb2441fe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.764524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcc49-5092-4304-8ede-c707035cf323 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.765335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcc49-5092-4304-8ede-c707035cf323 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.765639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcc49-5092-4304-8ede-c707035cf323 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.765909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf5dcc49-5092-4304-8ede-c707035cf323 admin admin] PATH_INFO: `/v3/projects/ad9b9a00472e49d6a070703d77479d96/users/8844ededd0324c6d81d54fcb9b884d5b/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.789653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dcc49-5092-4304-8ede-c707035cf323 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9b9a00472e49d6a070703d77479d96, user_id=8844ededd0324c6d81d54fcb9b884d5b, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.792313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf5dcc49-5092-4304-8ede-c707035cf323 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.808210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1074/2172] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:18 2022] PUT /identity/v3/projects/ad9b9a00472e49d6a070703d77479d96/users/8844ededd0324c6d81d54fcb9b884d5b/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:18.812119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f28db0-1971-4e7e-a1b9-1f6dc75c64d2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.822227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f28db0-1971-4e7e-a1b9-1f6dc75c64d2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.886036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d0a2cfe-5b64-4fda-a4a0-50512ec2a8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.886697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2cfe-5b64-4fda-a4a0-50512ec2a8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.886979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2cfe-5b64-4fda-a4a0-50512ec2a8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.887255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d0a2cfe-5b64-4fda-a4a0-50512ec2a8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.887970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2cfe-5b64-4fda-a4a0-50512ec2a8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.889591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d0a2cfe-5b64-4fda-a4a0-50512ec2a8a9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.899912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1099/2173] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:18 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:18.904268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcc49-5092-4304-8ede-c707035cf323 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:18.915117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf5dcc49-5092-4304-8ede-c707035cf323 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:18.919599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:18.920456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.920733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.921003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] PATH_INFO: `/v3/projects/ad9b9a00472e49d6a070703d77479d96/users/8844ededd0324c6d81d54fcb9b884d5b/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.922962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ad9b9a00472e49d6a070703d77479d96, user_id=8844ededd0324c6d81d54fcb9b884d5b, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:18.925757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:18.936309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1075/2174] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:18 2022] PUT /identity/v3/projects/ad9b9a00472e49d6a070703d77479d96/users/8844ededd0324c6d81d54fcb9b884d5b/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:18.947758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bad47f-046e-4ed5-bb33-bf6fa3911ae3 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:18.948048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bad47f-046e-4ed5-bb33-bf6fa3911ae3 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:18.948353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5bad47f-046e-4ed5-bb33-bf6fa3911ae3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:18.974598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a5bad47f-046e-4ed5-bb33-bf6fa3911ae3 None None] MFA Rules not processed for user `8844ededd0324c6d81d54fcb9b884d5b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:18.975911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a5bad47f-046e-4ed5-bb33-bf6fa3911ae3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:19.044633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1100/2175] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:19.056153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:19.057945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:19.116591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6591d8c-65db-4801-b25f-6efe8563d6bb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:19.120282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:19.120920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:19.121192 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:19.121588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:19.178748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:19.180175 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:19.188916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1076/2176] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:19 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:20.672698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bad47f-046e-4ed5-bb33-bf6fa3911ae3 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:20.677236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:20.683634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5bad47f-046e-4ed5-bb33-bf6fa3911ae3 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:20.687152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec198d2-c3fe-414e-bef9-0df096d0e50c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:20.687779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec198d2-c3fe-414e-bef9-0df096d0e50c service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:20.688055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec198d2-c3fe-414e-bef9-0df096d0e50c service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:20.688321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec198d2-c3fe-414e-bef9-0df096d0e50c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:20.743116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec198d2-c3fe-414e-bef9-0df096d0e50c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:20.744541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec198d2-c3fe-414e-bef9-0df096d0e50c service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:20.753402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1101/2177] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:20 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:21.318602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:21.319990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:21.331988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1267b6-248e-4e5c-8068-f19a96d9f6dc service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:21.335689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b08d4800-91a0-4b40-bfcc-f459e0bbc5eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:21.336316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4800-91a0-4b40-bfcc-f459e0bbc5eb service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:21.336595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4800-91a0-4b40-bfcc-f459e0bbc5eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:21.336865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b08d4800-91a0-4b40-bfcc-f459e0bbc5eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:21.346333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d4800-91a0-4b40-bfcc-f459e0bbc5eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:21.347802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b08d4800-91a0-4b40-bfcc-f459e0bbc5eb service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:21.357409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1077/2178] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:21 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:25.214555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec198d2-c3fe-414e-bef9-0df096d0e50c service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:25.276955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec198d2-c3fe-414e-bef9-0df096d0e50c service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:25.281703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:25.282563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:25.282840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:25.283116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] PATH_INFO: `/v3/users/c45b6ea0f6f0446890d896c6e1274396` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:25.284419 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=c45b6ea0f6f0446890d896c6e1274396)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:25.286436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:25.335607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c45b6ea0f6f0446890d896c6e1274396'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:25.342766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c45b6ea0f6f0446890d896c6e1274396'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:25.350025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c45b6ea0f6f0446890d896c6e1274396'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:25.362272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c45b6ea0f6f0446890d896c6e1274396'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:25.362879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c45b6ea0f6f0446890d896c6e1274396'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:25.368899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1102/2179] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:25 2022] DELETE /identity/v3/users/c45b6ea0f6f0446890d896c6e1274396 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:25.374443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeb74b-d5a9-4f3f-8b36-0e45dcc65b0d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:25.374936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeb74b-d5a9-4f3f-8b36-0e45dcc65b0d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:25.375064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eeb74b-d5a9-4f3f-8b36-0e45dcc65b0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:25.382141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:25.394011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b3eeb74b-d5a9-4f3f-8b36-0e45dcc65b0d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:25.395217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3eeb74b-d5a9-4f3f-8b36-0e45dcc65b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:25.459667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1078/2180] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:25.469634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:25.471361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:25.492957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:25.532175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ffc5f16-34d3-4712-bc91-f41385e090ce admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:25.535613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c8e1e-2dc6-4085-92b4-88067f519c92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:25.536260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c8e1e-2dc6-4085-92b4-88067f519c92 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:25.536535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c8e1e-2dc6-4085-92b4-88067f519c92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:25.536800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d15c8e1e-2dc6-4085-92b4-88067f519c92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:25.547223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c8e1e-2dc6-4085-92b4-88067f519c92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:25.548670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d15c8e1e-2dc6-4085-92b4-88067f519c92 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:25.559051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1103/2181] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:38:25.892810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeb74b-d5a9-4f3f-8b36-0e45dcc65b0d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:25.894966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b3eeb74b-d5a9-4f3f-8b36-0e45dcc65b0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:25.924497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eeb74b-d5a9-4f3f-8b36-0e45dcc65b0d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:25.932388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:25.934073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:25.934674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:25.935099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] PATH_INFO: `/v3/projects/0e7556f80c594a858a7f5c9977863f8a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:25.936613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] RBAC: Authorizing `identity:delete_project(project_id=0e7556f80c594a858a7f5c9977863f8a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:25.938889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:26.016311 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0e7556f80c594a858a7f5c9977863f8a', 'request_id': 'req-586926c9-57d8-4884-b5d2-5d42608ed72e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.024562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0e7556f80c594a858a7f5c9977863f8a', 'request_id': 'req-586926c9-57d8-4884-b5d2-5d42608ed72e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.036773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0e7556f80c594a858a7f5c9977863f8a', 'request_id': 'req-586926c9-57d8-4884-b5d2-5d42608ed72e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.051140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] The token cache is being invalidate because project 0e7556f80c594a858a7f5c9977863f8a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:26.051368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.052172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.057691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1079/2182] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:25 2022] DELETE /identity/v3/projects/0e7556f80c594a858a7f5c9977863f8a => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:26.074170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c8e1e-2dc6-4085-92b4-88067f519c92 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:26.094035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d15c8e1e-2dc6-4085-92b4-88067f519c92 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:26.187998 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:26.189559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:26.189845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:26.190118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] PATH_INFO: `/v3/users/8d3ef5be9915454a8c185e04695b12ef` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:26.191832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d3ef5be9915454a8c185e04695b12ef)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:26.194807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:26.253911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d3ef5be9915454a8c185e04695b12ef'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.261594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d3ef5be9915454a8c185e04695b12ef'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.270211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d3ef5be9915454a8c185e04695b12ef'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.285573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d3ef5be9915454a8c185e04695b12ef'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.286265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d3ef5be9915454a8c185e04695b12ef'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.293675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1104/2183] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:26 2022] DELETE /identity/v3/users/8d3ef5be9915454a8c185e04695b12ef => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:26.686374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:26.688123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:26.705019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-586926c9-57d8-4884-b5d2-5d42608ed72e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:26.763644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:26.764574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:26.764848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:26.765113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] PATH_INFO: `/v3/projects/bd54ca5461004a9a883dac912f5d205b` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:26.766441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd54ca5461004a9a883dac912f5d205b)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:26.768658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:26.802680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:26.820546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd54ca5461004a9a883dac912f5d205b', 'request_id': 'req-9cfbd08e-61aa-479a-bac9-631275c5b439'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.826847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd54ca5461004a9a883dac912f5d205b', 'request_id': 'req-9cfbd08e-61aa-479a-bac9-631275c5b439'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.834289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd54ca5461004a9a883dac912f5d205b', 'request_id': 'req-9cfbd08e-61aa-479a-bac9-631275c5b439'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.845688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] The token cache is being invalidate because project bd54ca5461004a9a883dac912f5d205b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:26.846048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.846730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.848477 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1080/2184] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:26 2022] DELETE /identity/v3/projects/bd54ca5461004a9a883dac912f5d205b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:26.852782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:26.854389 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:26.867024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f795ba-b0b9-4464-9219-cee82dedca1a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:26.910320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:26.927995 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:26.928861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:26.929135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:26.929434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] PATH_INFO: `/v3/users/8844ededd0324c6d81d54fcb9b884d5b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:26.930612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8844ededd0324c6d81d54fcb9b884d5b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:26.933036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:26.980388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8844ededd0324c6d81d54fcb9b884d5b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.987383 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8844ededd0324c6d81d54fcb9b884d5b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:26.996165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8844ededd0324c6d81d54fcb9b884d5b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:27.008217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8844ededd0324c6d81d54fcb9b884d5b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:27.008850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-22ff2bc4-6ba0-46fa-a56a-29b0c3ee5692 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8844ededd0324c6d81d54fcb9b884d5b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:27.015585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1105/2185] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:26 2022] DELETE /identity/v3/users/8844ededd0324c6d81d54fcb9b884d5b => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:27.350759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:27.352441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:27.366471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cfbd08e-61aa-479a-bac9-631275c5b439 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:27.431375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:27.432296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.433240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.433581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] PATH_INFO: `/v3/projects/ad9b9a00472e49d6a070703d77479d96` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.434800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ad9b9a00472e49d6a070703d77479d96)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:27.436705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:27.485529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ad9b9a00472e49d6a070703d77479d96', 'request_id': 'req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:27.490909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ad9b9a00472e49d6a070703d77479d96', 'request_id': 'req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:27.498309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ad9b9a00472e49d6a070703d77479d96', 'request_id': 'req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:27.509196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] The token cache is being invalidate because project ad9b9a00472e49d6a070703d77479d96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:27.509510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:27.510129 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7b3dc8d7-eab9-460b-9cbd-28ddad14a6e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:27.511738 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1081/2186] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:27 2022] DELETE /identity/v3/projects/ad9b9a00472e49d6a070703d77479d96 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:27.516553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7479d9-090e-491b-a5ef-fe6da0c98044 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.517018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7479d9-090e-491b-a5ef-fe6da0c98044 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.517129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7479d9-090e-491b-a5ef-fe6da0c98044 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.535813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0d7479d9-090e-491b-a5ef-fe6da0c98044 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:27.537011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0d7479d9-090e-491b-a5ef-fe6da0c98044 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:27.598235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1106/2187] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:27.606425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09f83-6e36-44cc-9767-138fa95eb73c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.606714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09f83-6e36-44cc-9767-138fa95eb73c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.606991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a09f83-6e36-44cc-9767-138fa95eb73c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.625869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e2a09f83-6e36-44cc-9767-138fa95eb73c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:27.627105 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e2a09f83-6e36-44cc-9767-138fa95eb73c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:27.634824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1082/2188] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:38:27.638840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7479d9-090e-491b-a5ef-fe6da0c98044 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:27.648314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7479d9-090e-491b-a5ef-fe6da0c98044 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:27.654016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:27.654651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.654926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.655195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.655909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:38:27.656212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:27.657841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:27.669778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1107/2189] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:38:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:38:27.673784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a09f83-6e36-44cc-9767-138fa95eb73c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:27.682859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a09f83-6e36-44cc-9767-138fa95eb73c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:27.687337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c1b00-8aac-40f9-a4a1-0f9859ae1261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:27.687968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c1b00-8aac-40f9-a4a1-0f9859ae1261 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.688250 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c1b00-8aac-40f9-a4a1-0f9859ae1261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.688520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a60c1b00-8aac-40f9-a4a1-0f9859ae1261 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.689212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c1b00-8aac-40f9-a4a1-0f9859ae1261 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:27.691141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a60c1b00-8aac-40f9-a4a1-0f9859ae1261 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:27.719107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1083/2190] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:27 2022] POST /identity/v3/projects => generated 385 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:38:27.720243 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:27.730791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33834f9-c9ba-4d16-ae13-168594dc45f2 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:27.772734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:27.787503 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a7a4-1c1f-4c92-aca6-d9bbdfe8c679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:27.788171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a7a4-1c1f-4c92-aca6-d9bbdfe8c679 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.788451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a7a4-1c1f-4c92-aca6-d9bbdfe8c679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.788725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce14a7a4-1c1f-4c92-aca6-d9bbdfe8c679 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.789428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14a7a4-1c1f-4c92-aca6-d9bbdfe8c679 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:27.791362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce14a7a4-1c1f-4c92-aca6-d9bbdfe8c679 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:27.810891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1108/2191] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:27 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:38:27.814959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c1b00-8aac-40f9-a4a1-0f9859ae1261 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:27.825961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a60c1b00-8aac-40f9-a4a1-0f9859ae1261 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:27.830595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeab110-13b0-4feb-8066-5b92a3c340bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:27.831248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeab110-13b0-4feb-8066-5b92a3c340bf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.831528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeab110-13b0-4feb-8066-5b92a3c340bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.831803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfeab110-13b0-4feb-8066-5b92a3c340bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.832520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeab110-13b0-4feb-8066-5b92a3c340bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:27.834146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfeab110-13b0-4feb-8066-5b92a3c340bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:27.844688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1084/2192] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:38:27.848409 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a7a4-1c1f-4c92-aca6-d9bbdfe8c679 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:27.858609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce14a7a4-1c1f-4c92-aca6-d9bbdfe8c679 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:27.863105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8608d436-4b0e-4d2e-bc67-589063f8e45f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:27.863744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d436-4b0e-4d2e-bc67-589063f8e45f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.864028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d436-4b0e-4d2e-bc67-589063f8e45f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.864302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8608d436-4b0e-4d2e-bc67-589063f8e45f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.865017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608d436-4b0e-4d2e-bc67-589063f8e45f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:27.866629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8608d436-4b0e-4d2e-bc67-589063f8e45f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:27.876970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1109/2193] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:27 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:27.880985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeab110-13b0-4feb-8066-5b92a3c340bf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:27.890943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfeab110-13b0-4feb-8066-5b92a3c340bf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:27.895396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:27.896263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.896661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.896946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] PATH_INFO: `/v3/projects/0cba623e7fc54ba9bc9ce62a43758f8d/users/8976b15c4e6449bcbddc1c8d8f7188ca/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.899976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:27.912874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cba623e7fc54ba9bc9ce62a43758f8d, user_id=8976b15c4e6449bcbddc1c8d8f7188ca, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:27.915586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:27.928253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1085/2194] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:27 2022] PUT /identity/v3/projects/0cba623e7fc54ba9bc9ce62a43758f8d/users/8976b15c4e6449bcbddc1c8d8f7188ca/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:27.938781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4bb3-f06a-4cc6-9cdf-925e730b394f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:27.939065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4bb3-f06a-4cc6-9cdf-925e730b394f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:27.939334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-511b4bb3-f06a-4cc6-9cdf-925e730b394f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:27.964958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-511b4bb3-f06a-4cc6-9cdf-925e730b394f None None] MFA Rules not processed for user `8976b15c4e6449bcbddc1c8d8f7188ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:27.966441 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-511b4bb3-f06a-4cc6-9cdf-925e730b394f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:28.029751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1110/2195] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:28.040602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:28.043024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:28.099657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bda8281-990f-4c37-b4e1-c511e1c2f3a3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:28.103191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec9b57e-e932-4e36-9579-c8e652029f0a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:28.103823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b57e-e932-4e36-9579-c8e652029f0a service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:28.104101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b57e-e932-4e36-9579-c8e652029f0a service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:28.105094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec9b57e-e932-4e36-9579-c8e652029f0a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:28.113534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9b57e-e932-4e36-9579-c8e652029f0a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:28.114949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec9b57e-e932-4e36-9579-c8e652029f0a service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:28.124245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1086/2196] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:28 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:38.027079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=44,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:38.119635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=32,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:38.224528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b4bb3-f06a-4cc6-9cdf-925e730b394f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:38.286624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-511b4bb3-f06a-4cc6-9cdf-925e730b394f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:38.291071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:38.291928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:38.292815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:38.293870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] PATH_INFO: `/v3/users/8976b15c4e6449bcbddc1c8d8f7188ca` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:38.294233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8976b15c4e6449bcbddc1c8d8f7188ca)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:38.296143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:38.350405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8976b15c4e6449bcbddc1c8d8f7188ca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.358458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8976b15c4e6449bcbddc1c8d8f7188ca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.367488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8976b15c4e6449bcbddc1c8d8f7188ca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.382425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8976b15c4e6449bcbddc1c8d8f7188ca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.383275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8976b15c4e6449bcbddc1c8d8f7188ca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.391735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1111/2197] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:38 2022] DELETE /identity/v3/users/8976b15c4e6449bcbddc1c8d8f7188ca => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:38.396313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477916-628e-44e9-9cf4-3408a8dad02f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:38.396604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477916-628e-44e9-9cf4-3408a8dad02f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:38.396901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a477916-628e-44e9-9cf4-3408a8dad02f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:38.415745 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4a477916-628e-44e9-9cf4-3408a8dad02f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:38.416958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4a477916-628e-44e9-9cf4-3408a8dad02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:38.486008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1087/2198] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:38:38.496459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:38.498023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:38.554272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7341a61-3acc-404c-9975-2bf5d0a488a3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:38.557752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c80187-8fdb-4d9f-a584-0730c97ff72f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:38.558406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c80187-8fdb-4d9f-a584-0730c97ff72f service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:38.558690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c80187-8fdb-4d9f-a584-0730c97ff72f service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:38.558961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c80187-8fdb-4d9f-a584-0730c97ff72f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:38.567796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c80187-8fdb-4d9f-a584-0730c97ff72f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:38.569210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c80187-8fdb-4d9f-a584-0730c97ff72f service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:38.578946 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1112/2199] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:38.873837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477916-628e-44e9-9cf4-3408a8dad02f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:38.875327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4a477916-628e-44e9-9cf4-3408a8dad02f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:38.888775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a477916-628e-44e9-9cf4-3408a8dad02f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:38.894220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:38.895101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:38.895334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:38.895680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] PATH_INFO: `/v3/projects/0cba623e7fc54ba9bc9ce62a43758f8d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:38.896763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cba623e7fc54ba9bc9ce62a43758f8d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:38.898687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:38.955431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cba623e7fc54ba9bc9ce62a43758f8d', 'request_id': 'req-66499796-d101-45e1-9b66-82c44bc40764'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.961230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cba623e7fc54ba9bc9ce62a43758f8d', 'request_id': 'req-66499796-d101-45e1-9b66-82c44bc40764'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.970927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cba623e7fc54ba9bc9ce62a43758f8d', 'request_id': 'req-66499796-d101-45e1-9b66-82c44bc40764'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.982729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] The token cache is being invalidate because project 0cba623e7fc54ba9bc9ce62a43758f8d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:38.983084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.983750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-66499796-d101-45e1-9b66-82c44bc40764 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:38.985482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1088/2200] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:38 2022] DELETE /identity/v3/projects/0cba623e7fc54ba9bc9ce62a43758f8d => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:38.990440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b186-d666-463f-822a-abaf14d4eb3e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:38.990727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b186-d666-463f-822a-abaf14d4eb3e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:38.991005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d314b186-d666-463f-822a-abaf14d4eb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.011139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d314b186-d666-463f-822a-abaf14d4eb3e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:39.012642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d314b186-d666-463f-822a-abaf14d4eb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:39.031520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:39.079070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1113/2201] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:39.087023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f9b-702f-489f-8430-d9ba80b84ad3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.087427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f9b-702f-489f-8430-d9ba80b84ad3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.087790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d483f9b-702f-489f-8430-d9ba80b84ad3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.108496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2d483f9b-702f-489f-8430-d9ba80b84ad3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:39.109965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2d483f9b-702f-489f-8430-d9ba80b84ad3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:39.129498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1089/2202] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:39.132039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b186-d666-463f-822a-abaf14d4eb3e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:39.144311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d314b186-d666-463f-822a-abaf14d4eb3e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:39.149098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:39.149875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.150368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.150623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.151340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:38:39.152376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:39.154475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:39.174914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d483f9b-702f-489f-8430-d9ba80b84ad3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:39.177755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1114/2203] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:38:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:38:39.184761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d483f9b-702f-489f-8430-d9ba80b84ad3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:39.190425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cfa2-921a-44e9-8f75-643df8332a1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:39.192486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cfa2-921a-44e9-8f75-643df8332a1e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.192486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cfa2-921a-44e9-8f75-643df8332a1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.192486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009cfa2-921a-44e9-8f75-643df8332a1e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.194159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009cfa2-921a-44e9-8f75-643df8332a1e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:39.194606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009cfa2-921a-44e9-8f75-643df8332a1e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:39.224882 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1090/2204] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:39 2022] POST /identity/v3/projects => generated 371 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:39.229005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:39.240239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2129b299-269c-480a-9481-cfeaff9007d3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:39.299301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddccbb4-73f8-40bc-b610-9970848ccfc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:39.299966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccbb4-73f8-40bc-b610-9970848ccfc0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.300248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccbb4-73f8-40bc-b610-9970848ccfc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.300522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddccbb4-73f8-40bc-b610-9970848ccfc0 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.301217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddccbb4-73f8-40bc-b610-9970848ccfc0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:39.303748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddccbb4-73f8-40bc-b610-9970848ccfc0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:39.323099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1115/2205] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:39 2022] POST /identity/v3/users => generated 286 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:39.327733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cfa2-921a-44e9-8f75-643df8332a1e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:39.337994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009cfa2-921a-44e9-8f75-643df8332a1e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:39.343140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47457484-a1d8-49ec-93ef-af895fc859e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:39.343791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47457484-a1d8-49ec-93ef-af895fc859e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.344076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47457484-a1d8-49ec-93ef-af895fc859e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.344350 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47457484-a1d8-49ec-93ef-af895fc859e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.345070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47457484-a1d8-49ec-93ef-af895fc859e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:39.346696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47457484-a1d8-49ec-93ef-af895fc859e8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:39.356895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1091/2206] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:39.360983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddccbb4-73f8-40bc-b610-9970848ccfc0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:39.371388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddccbb4-73f8-40bc-b610-9970848ccfc0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:39.376175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53912359-bc7d-45f2-9c53-5d481c355037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:39.376978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912359-bc7d-45f2-9c53-5d481c355037 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.377262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912359-bc7d-45f2-9c53-5d481c355037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.377728 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53912359-bc7d-45f2-9c53-5d481c355037 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.378390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53912359-bc7d-45f2-9c53-5d481c355037 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:39.379986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53912359-bc7d-45f2-9c53-5d481c355037 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:39.394362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1116/2207] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:39 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:39.395424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47457484-a1d8-49ec-93ef-af895fc859e8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:39.406550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47457484-a1d8-49ec-93ef-af895fc859e8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:39.411362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:39.412481 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.412952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.413365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] PATH_INFO: `/v3/projects/f3a34bc05b0946f08ef97edb6cc77c74/users/7a797877a4ec4879ad0676302a2f2182/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.433554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f3a34bc05b0946f08ef97edb6cc77c74, user_id=7a797877a4ec4879ad0676302a2f2182, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:39.437783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:39.450900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1092/2208] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:39 2022] PUT /identity/v3/projects/f3a34bc05b0946f08ef97edb6cc77c74/users/7a797877a4ec4879ad0676302a2f2182/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:39.461059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a62467-fca7-464f-bb2a-7902668389f8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.461589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a62467-fca7-464f-bb2a-7902668389f8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.461968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a62467-fca7-464f-bb2a-7902668389f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.497062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-81a62467-fca7-464f-bb2a-7902668389f8 None None] MFA Rules not processed for user `7a797877a4ec4879ad0676302a2f2182`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:39.498394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-81a62467-fca7-464f-bb2a-7902668389f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:39.566044 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1117/2209] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:39 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:39.576891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:39.578561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:39.601170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:39.643222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7116c70-2324-4569-80a9-4974ab6a3324 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:39.646830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0265e53-1793-4dcb-aab3-a956afcc222e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:39.647489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0265e53-1793-4dcb-aab3-a956afcc222e service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:39.647768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0265e53-1793-4dcb-aab3-a956afcc222e service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:39.648065 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0265e53-1793-4dcb-aab3-a956afcc222e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:39.657493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0265e53-1793-4dcb-aab3-a956afcc222e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:39.659012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0265e53-1793-4dcb-aab3-a956afcc222e service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:39.670007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1093/2210] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:39 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:45.799414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a62467-fca7-464f-bb2a-7902668389f8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:45.800888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-81a62467-fca7-464f-bb2a-7902668389f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:45.824590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:45.879508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a62467-fca7-464f-bb2a-7902668389f8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:45.884370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:45.885266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:45.886339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:45.886339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] PATH_INFO: `/v3/users/df5fb58c15e648acb9ed2281ae0f47d8` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:45.887578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] RBAC: Authorizing `identity:delete_user(user_id=df5fb58c15e648acb9ed2281ae0f47d8)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:45.889569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:45.951740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'df5fb58c15e648acb9ed2281ae0f47d8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:45.961649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'df5fb58c15e648acb9ed2281ae0f47d8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:45.972061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'df5fb58c15e648acb9ed2281ae0f47d8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:45.996411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'df5fb58c15e648acb9ed2281ae0f47d8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:45.997182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'df5fb58c15e648acb9ed2281ae0f47d8'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:46.004325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1118/2211] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:45 2022] DELETE /identity/v3/users/df5fb58c15e648acb9ed2281ae0f47d8 => generated 0 bytes in 205 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:46.009243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722f634-194d-4648-8a98-337f61f857cb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:46.010744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722f634-194d-4648-8a98-337f61f857cb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:46.011043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0722f634-194d-4648-8a98-337f61f857cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:46.032561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-0722f634-194d-4648-8a98-337f61f857cb None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:46.034025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0722f634-194d-4648-8a98-337f61f857cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:46.128182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1094/2212] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:46.138279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:46.139861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:46.228785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fc212fa-7cf3-483e-8d9d-07a681e66e8b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:46.233471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:46.234228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:46.234581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:46.234932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:46.247674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:46.249145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:46.260814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1119/2213] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:46.563113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722f634-194d-4648-8a98-337f61f857cb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:46.564754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0722f634-194d-4648-8a98-337f61f857cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:46.601159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0722f634-194d-4648-8a98-337f61f857cb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:46.608431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:46.609307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:46.609634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:46.609910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] PATH_INFO: `/v3/projects/7538372bf3494ea9bdf09bcc912f04bf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:46.613035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7538372bf3494ea9bdf09bcc912f04bf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:46.615066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:46.685822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7538372bf3494ea9bdf09bcc912f04bf', 'request_id': 'req-c1320f01-cbe6-46f2-aad3-8730e3967932'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:46.693588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7538372bf3494ea9bdf09bcc912f04bf', 'request_id': 'req-c1320f01-cbe6-46f2-aad3-8730e3967932'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:46.707819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7538372bf3494ea9bdf09bcc912f04bf', 'request_id': 'req-c1320f01-cbe6-46f2-aad3-8730e3967932'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:46.721616 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] The token cache is being invalidate because project 7538372bf3494ea9bdf09bcc912f04bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:46.721892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:46.722542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c1320f01-cbe6-46f2-aad3-8730e3967932 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:46.737926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1095/2214] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:46 2022] DELETE /identity/v3/projects/7538372bf3494ea9bdf09bcc912f04bf => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:50.427953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:50.429561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:50.443190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bca22ecf-cd1f-477c-9ec6-5e67bc641295 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:50.483049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:50.503897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:50.504772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:50.505049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:50.505320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] PATH_INFO: `/v3/users/09e541a38adf4b4a9091044e8baf6f51` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:50.506571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] RBAC: Authorizing `identity:delete_user(user_id=09e541a38adf4b4a9091044e8baf6f51)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:50.508537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:50.556451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '09e541a38adf4b4a9091044e8baf6f51'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:50.563610 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '09e541a38adf4b4a9091044e8baf6f51'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:50.570738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '09e541a38adf4b4a9091044e8baf6f51'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:50.584339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '09e541a38adf4b4a9091044e8baf6f51'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:50.585008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '09e541a38adf4b4a9091044e8baf6f51'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:50.591487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1120/2215] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:50 2022] DELETE /identity/v3/users/09e541a38adf4b4a9091044e8baf6f51 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:50.596235 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b988abe-1f41-437c-ad6b-39415850791e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:50.596741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b988abe-1f41-437c-ad6b-39415850791e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:50.596842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b988abe-1f41-437c-ad6b-39415850791e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:50.614043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6b988abe-1f41-437c-ad6b-39415850791e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:50.615256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b988abe-1f41-437c-ad6b-39415850791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:50.657159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:50.677216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1096/2216] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:50.687723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:50.689152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:50.746953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba09d1b4-c66c-442f-ad2d-fe7b064b213b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:50.751652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ecf77-d06f-4396-9617-dd1725675d1b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:50.752458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecf77-d06f-4396-9617-dd1725675d1b service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:50.752849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecf77-d06f-4396-9617-dd1725675d1b service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:50.753182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ecf77-d06f-4396-9617-dd1725675d1b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:50.765127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ecf77-d06f-4396-9617-dd1725675d1b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:50.766713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ecf77-d06f-4396-9617-dd1725675d1b service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:50.776391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1121/2217] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:51.328375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b988abe-1f41-437c-ad6b-39415850791e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:51.330154 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6b988abe-1f41-437c-ad6b-39415850791e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:51.345780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b988abe-1f41-437c-ad6b-39415850791e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:51.350589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:51.351574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.351861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.352132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] PATH_INFO: `/v3/projects/30fbdddf4bba4c93b5924ccea195f7d3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.353303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] RBAC: Authorizing `identity:delete_project(project_id=30fbdddf4bba4c93b5924ccea195f7d3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:51.356146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:51.407715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30fbdddf4bba4c93b5924ccea195f7d3', 'request_id': 'req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:51.413629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30fbdddf4bba4c93b5924ccea195f7d3', 'request_id': 'req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:51.424171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30fbdddf4bba4c93b5924ccea195f7d3', 'request_id': 'req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:51.436557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] The token cache is being invalidate because project 30fbdddf4bba4c93b5924ccea195f7d3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:51.436842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:51.437508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e85c81ac-90aa-4a6e-ae14-5d33c9d6395b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:51.439054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1097/2218] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:51 2022] DELETE /identity/v3/projects/30fbdddf4bba4c93b5924ccea195f7d3 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:38:51.443883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261baa-9b36-4d3c-bef7-db99bc56754e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.444332 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261baa-9b36-4d3c-bef7-db99bc56754e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.444454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c261baa-9b36-4d3c-bef7-db99bc56754e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.463148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7c261baa-9b36-4d3c-bef7-db99bc56754e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:51.464770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c261baa-9b36-4d3c-bef7-db99bc56754e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:51.527952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1122/2219] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:51.535839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c126c59-fbd3-47f7-8b53-4d59ccab38a6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.536206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c126c59-fbd3-47f7-8b53-4d59ccab38a6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.536509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c126c59-fbd3-47f7-8b53-4d59ccab38a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.557153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4c126c59-fbd3-47f7-8b53-4d59ccab38a6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:51.559191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4c126c59-fbd3-47f7-8b53-4d59ccab38a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:51.567930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1098/2220] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:51.572218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c261baa-9b36-4d3c-bef7-db99bc56754e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:51.578972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:51.583952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c261baa-9b36-4d3c-bef7-db99bc56754e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:51.590719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:51.591794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.592549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.592900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.593701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:38:51.594053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:51.595786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:51.609080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1123/2221] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:38:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:38:51.613591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c126c59-fbd3-47f7-8b53-4d59ccab38a6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:51.623406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c126c59-fbd3-47f7-8b53-4d59ccab38a6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:51.628187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d480f3-25ed-4b90-99fa-73168864b9b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:51.628884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d480f3-25ed-4b90-99fa-73168864b9b4 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.629191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d480f3-25ed-4b90-99fa-73168864b9b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.629456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d480f3-25ed-4b90-99fa-73168864b9b4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.630351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d480f3-25ed-4b90-99fa-73168864b9b4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:51.632472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d480f3-25ed-4b90-99fa-73168864b9b4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:51.661287 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1099/2222] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:51 2022] POST /identity/v3/projects => generated 397 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:51.666210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:51.677144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08edcaa6-f552-46ec-9019-72d2ac05e4ff admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:51.737559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328f7b8-28fe-403a-b23f-41471d485395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:51.738225 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328f7b8-28fe-403a-b23f-41471d485395 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.738506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328f7b8-28fe-403a-b23f-41471d485395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.738779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1328f7b8-28fe-403a-b23f-41471d485395 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.739509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328f7b8-28fe-403a-b23f-41471d485395 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:51.741455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1328f7b8-28fe-403a-b23f-41471d485395 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:51.761111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1124/2223] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:51 2022] POST /identity/v3/users => generated 299 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:51.765264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d480f3-25ed-4b90-99fa-73168864b9b4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:51.776017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d480f3-25ed-4b90-99fa-73168864b9b4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:51.781817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a70b2-18e1-4a20-9c00-ac3d86715277 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:51.782526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a70b2-18e1-4a20-9c00-ac3d86715277 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.782919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a70b2-18e1-4a20-9c00-ac3d86715277 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.783267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179a70b2-18e1-4a20-9c00-ac3d86715277 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.784102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a70b2-18e1-4a20-9c00-ac3d86715277 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:51.785879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-179a70b2-18e1-4a20-9c00-ac3d86715277 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:51.796412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1100/2224] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:38:51.800723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328f7b8-28fe-403a-b23f-41471d485395 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:51.811190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1328f7b8-28fe-403a-b23f-41471d485395 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:51.815735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ff33918-1c7c-4294-9035-af3ed0a6ab3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:51.816381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33918-1c7c-4294-9035-af3ed0a6ab3f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.816659 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33918-1c7c-4294-9035-af3ed0a6ab3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.816932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff33918-1c7c-4294-9035-af3ed0a6ab3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.817685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff33918-1c7c-4294-9035-af3ed0a6ab3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:51.819275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ff33918-1c7c-4294-9035-af3ed0a6ab3f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:51.829974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1125/2225] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:38:51.834141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a70b2-18e1-4a20-9c00-ac3d86715277 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:51.844756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179a70b2-18e1-4a20-9c00-ac3d86715277 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:51.849850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:51.850709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.850984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.851254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] PATH_INFO: `/v3/projects/e059b4be6be744f7a2cbdf7aa25257d6/users/f1aa77315af4454bacf4b0d6af942a30/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.866847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e059b4be6be744f7a2cbdf7aa25257d6, user_id=f1aa77315af4454bacf4b0d6af942a30, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:51.869731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:51.883056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1101/2226] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:51 2022] PUT /identity/v3/projects/e059b4be6be744f7a2cbdf7aa25257d6/users/f1aa77315af4454bacf4b0d6af942a30/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:51.894977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab1114-e8a9-44b1-b76c-9f2d5d4ba8c8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:51.895445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab1114-e8a9-44b1-b76c-9f2d5d4ba8c8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:51.895716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ab1114-e8a9-44b1-b76c-9f2d5d4ba8c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:51.921745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-a5ab1114-e8a9-44b1-b76c-9f2d5d4ba8c8 None None] MFA Rules not processed for user `f1aa77315af4454bacf4b0d6af942a30`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:51.923075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a5ab1114-e8a9-44b1-b76c-9f2d5d4ba8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:51.990759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1126/2227] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:51 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:52.002862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:52.004506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:52.064983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0508023-7a5d-42c9-8939-a4db8a0f1298 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:52.069055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d848f331-bd36-4a3b-a5a4-29aa1bb1efb0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:52.069735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f331-bd36-4a3b-a5a4-29aa1bb1efb0 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:52.070018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f331-bd36-4a3b-a5a4-29aa1bb1efb0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:52.070295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d848f331-bd36-4a3b-a5a4-29aa1bb1efb0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:52.081143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848f331-bd36-4a3b-a5a4-29aa1bb1efb0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:52.082427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d848f331-bd36-4a3b-a5a4-29aa1bb1efb0 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:52.096673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1102/2228] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:52 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:53.244495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab1114-e8a9-44b1-b76c-9f2d5d4ba8c8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:53.246738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a5ab1114-e8a9-44b1-b76c-9f2d5d4ba8c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:53.312575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:53.316834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5ab1114-e8a9-44b1-b76c-9f2d5d4ba8c8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:53.322381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:53.323625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:53.323903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:53.324487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] PATH_INFO: `/v3/users/7a797877a4ec4879ad0676302a2f2182` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:53.325984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7a797877a4ec4879ad0676302a2f2182)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:53.327934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:53.379404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7a797877a4ec4879ad0676302a2f2182'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:53.387573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7a797877a4ec4879ad0676302a2f2182'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:53.395571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7a797877a4ec4879ad0676302a2f2182'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:53.415193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7a797877a4ec4879ad0676302a2f2182'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:53.415193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7a797877a4ec4879ad0676302a2f2182'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:53.422092 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1127/2229] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:38:53 2022] DELETE /identity/v3/users/7a797877a4ec4879ad0676302a2f2182 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:53.426810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8977b-1ecd-42d2-b316-f9a8e4884901 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:53.427538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8977b-1ecd-42d2-b316-f9a8e4884901 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:53.427538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a8977b-1ecd-42d2-b316-f9a8e4884901 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:53.447652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-47a8977b-1ecd-42d2-b316-f9a8e4884901 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:53.449265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-47a8977b-1ecd-42d2-b316-f9a8e4884901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:53.453545 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:53.515382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1103/2230] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:38:53.524764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:53.526236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:53.584636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d743dcb7-5dcb-4679-b2fe-d20a40b4c4c9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:53.589252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab78ed8-6f13-4aa1-bb08-921a62fcd1d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:53.590538 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab78ed8-6f13-4aa1-bb08-921a62fcd1d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:53.590824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab78ed8-6f13-4aa1-bb08-921a62fcd1d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:53.591319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab78ed8-6f13-4aa1-bb08-921a62fcd1d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:53.603165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab78ed8-6f13-4aa1-bb08-921a62fcd1d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:53.606053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab78ed8-6f13-4aa1-bb08-921a62fcd1d2 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:53.616784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1128/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:53.920736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8977b-1ecd-42d2-b316-f9a8e4884901 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:53.922298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-47a8977b-1ecd-42d2-b316-f9a8e4884901 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:53.935280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a8977b-1ecd-42d2-b316-f9a8e4884901 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:53.941059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:53.942098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:53.942453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:53.942903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] PATH_INFO: `/v3/projects/f3a34bc05b0946f08ef97edb6cc77c74` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:53.952112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f3a34bc05b0946f08ef97edb6cc77c74)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:53.954256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:54.003699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f3a34bc05b0946f08ef97edb6cc77c74', 'request_id': 'req-d97ed345-1f98-46a1-beea-11cf52b2d52d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:54.011207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f3a34bc05b0946f08ef97edb6cc77c74', 'request_id': 'req-d97ed345-1f98-46a1-beea-11cf52b2d52d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:54.018466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f3a34bc05b0946f08ef97edb6cc77c74', 'request_id': 'req-d97ed345-1f98-46a1-beea-11cf52b2d52d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:54.030954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] The token cache is being invalidate because project f3a34bc05b0946f08ef97edb6cc77c74 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:38:54.031339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:54.032099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d97ed345-1f98-46a1-beea-11cf52b2d52d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:38:54.034095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1104/2232] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:38:53 2022] DELETE /identity/v3/projects/f3a34bc05b0946f08ef97edb6cc77c74 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:54.039192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf777-d8c2-4e8d-92d4-418d1bbc48fb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.039527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf777-d8c2-4e8d-92d4-418d1bbc48fb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.039805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35cf777-d8c2-4e8d-92d4-418d1bbc48fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.058894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e35cf777-d8c2-4e8d-92d4-418d1bbc48fb None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:54.060087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e35cf777-d8c2-4e8d-92d4-418d1bbc48fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:54.125313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1129/2233] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:38:54.133735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364bb29-be24-451f-aee2-80aa0f69f981 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.134021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364bb29-be24-451f-aee2-80aa0f69f981 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.134298 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e364bb29-be24-451f-aee2-80aa0f69f981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.153071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e364bb29-be24-451f-aee2-80aa0f69f981 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:54.154548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e364bb29-be24-451f-aee2-80aa0f69f981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:54.162331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1105/2234] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:54.166407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cf777-d8c2-4e8d-92d4-418d1bbc48fb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:54.176805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35cf777-d8c2-4e8d-92d4-418d1bbc48fb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:54.181378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:54.182052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.182601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.182931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.183656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:38:54.183968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:54.185593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:54.196916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1130/2235] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:38:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:38:54.201120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364bb29-be24-451f-aee2-80aa0f69f981 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:54.210757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e364bb29-be24-451f-aee2-80aa0f69f981 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:54.216907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32bb47-28dd-4c2c-aae8-b68aaacd970e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:54.217579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32bb47-28dd-4c2c-aae8-b68aaacd970e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.217859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32bb47-28dd-4c2c-aae8-b68aaacd970e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.218134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a32bb47-28dd-4c2c-aae8-b68aaacd970e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.218829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32bb47-28dd-4c2c-aae8-b68aaacd970e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:54.220743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a32bb47-28dd-4c2c-aae8-b68aaacd970e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:54.253200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1106/2236] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:38:54 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:54.254886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:54.265027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22c76cf3-4eee-465d-895a-51a3638fca4d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:54.268806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:54.324917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1d892-54ed-4ccc-9f9a-100afb44e590 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:54.325618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d892-54ed-4ccc-9f9a-100afb44e590 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.325904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d892-54ed-4ccc-9f9a-100afb44e590 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.326180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a1d892-54ed-4ccc-9f9a-100afb44e590 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.326879 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1d892-54ed-4ccc-9f9a-100afb44e590 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:54.328799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a1d892-54ed-4ccc-9f9a-100afb44e590 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:54.352620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1131/2237] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:38:54 2022] POST /identity/v3/users => generated 287 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:38:54.356242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32bb47-28dd-4c2c-aae8-b68aaacd970e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:54.366498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a32bb47-28dd-4c2c-aae8-b68aaacd970e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:54.371607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b56d7-105c-4a43-b360-63f47fa2b868 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:54.372304 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b56d7-105c-4a43-b360-63f47fa2b868 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.372586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b56d7-105c-4a43-b360-63f47fa2b868 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.372861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598b56d7-105c-4a43-b360-63f47fa2b868 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.373650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b56d7-105c-4a43-b360-63f47fa2b868 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:54.375269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598b56d7-105c-4a43-b360-63f47fa2b868 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:54.386211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1107/2238] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:38:54.390182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1d892-54ed-4ccc-9f9a-100afb44e590 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:54.400494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a1d892-54ed-4ccc-9f9a-100afb44e590 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:54.407036 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f059cd07-3d95-413b-bbba-71d6e678e36e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:54.407841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059cd07-3d95-413b-bbba-71d6e678e36e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.408120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059cd07-3d95-413b-bbba-71d6e678e36e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.408391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f059cd07-3d95-413b-bbba-71d6e678e36e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.409121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059cd07-3d95-413b-bbba-71d6e678e36e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:54.411278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f059cd07-3d95-413b-bbba-71d6e678e36e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:54.422840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1132/2239] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:38:54 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:38:54.426581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b56d7-105c-4a43-b360-63f47fa2b868 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:54.437990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598b56d7-105c-4a43-b360-63f47fa2b868 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:54.442737 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:54.443653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.443932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.444207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] PATH_INFO: `/v3/projects/e6be39781cc544e8a597279ec2d8750b/users/53633e955f694d3ebe03c0ea018a7d62/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.459394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e6be39781cc544e8a597279ec2d8750b, user_id=53633e955f694d3ebe03c0ea018a7d62, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:54.462082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:54.475521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1108/2240] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:38:54 2022] PUT /identity/v3/projects/e6be39781cc544e8a597279ec2d8750b/users/53633e955f694d3ebe03c0ea018a7d62/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:38:54.485943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fafd-c7f0-41c2-b97b-3f3a36fbb850 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.486237 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fafd-c7f0-41c2-b97b-3f3a36fbb850 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.486520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1567fafd-c7f0-41c2-b97b-3f3a36fbb850 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.514618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1567fafd-c7f0-41c2-b97b-3f3a36fbb850 None None] MFA Rules not processed for user `53633e955f694d3ebe03c0ea018a7d62`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:54.515825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1567fafd-c7f0-41c2-b97b-3f3a36fbb850 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:54.579963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1133/2241] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:54 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:38:54.590862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:38:54.592572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:54.626458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:38:54.655713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2944082c-fa28-48b3-88cd-24b885a169b3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:38:54.659970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:38:54.660622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:54.660911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:54.661185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:54.669868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:38:54.671251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:38:54.683637 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1109/2242] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:38:54 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:38:58.161245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fad45-c725-43ea-85ba-af54ec226d32 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:38:58.161793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fad45-c725-43ea-85ba-af54ec226d32 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:38:58.161873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265fad45-c725-43ea-85ba-af54ec226d32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:38:58.185664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-265fad45-c725-43ea-85ba-af54ec226d32 None None] MFA Rules not processed for user `53633e955f694d3ebe03c0ea018a7d62`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:38:58.186939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-265fad45-c725-43ea-85ba-af54ec226d32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:38:58.194161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1134/2243] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:38:58 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:00.376081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:00.377987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:00.475098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5ba4c29-e1a6-429f-b58e-7cac18a2c8cc service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:00.480473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:00.481346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:00.481653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:00.481924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] PATH_INFO: `/v3/users/f1aa77315af4454bacf4b0d6af942a30` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:00.483147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1aa77315af4454bacf4b0d6af942a30)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:00.485069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:00.547686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1aa77315af4454bacf4b0d6af942a30'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:00.560529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1aa77315af4454bacf4b0d6af942a30'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:00.569225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1aa77315af4454bacf4b0d6af942a30'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:00.577333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1aa77315af4454bacf4b0d6af942a30'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:00.577978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1aa77315af4454bacf4b0d6af942a30'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:00.587671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1110/2244] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:39:00 2022] DELETE /identity/v3/users/f1aa77315af4454bacf4b0d6af942a30 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:39:00.592282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5fc91-19bb-4670-990e-f6ac7e6ad7f0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:00.592740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5fc91-19bb-4670-990e-f6ac7e6ad7f0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:00.592830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd5fc91-19bb-4670-990e-f6ac7e6ad7f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:00.611470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dfd5fc91-19bb-4670-990e-f6ac7e6ad7f0 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:00.613220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dfd5fc91-19bb-4670-990e-f6ac7e6ad7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:00.688190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1135/2245] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:39:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:00.701872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:00.703290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:00.806498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689fd491-c26b-4e9e-b5ff-5447f8cd1c01 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:00.810494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b8f954-3b16-42cd-9358-ca1ebb681ef0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:00.811076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f954-3b16-42cd-9358-ca1ebb681ef0 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:00.811353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f954-3b16-42cd-9358-ca1ebb681ef0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:00.811731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b8f954-3b16-42cd-9358-ca1ebb681ef0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:00.819696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:00.824112 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8f954-3b16-42cd-9358-ca1ebb681ef0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:00.825842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b8f954-3b16-42cd-9358-ca1ebb681ef0 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:00.849850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1111/2246] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:39:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:39:01.327674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5fc91-19bb-4670-990e-f6ac7e6ad7f0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:01.329865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dfd5fc91-19bb-4670-990e-f6ac7e6ad7f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:01.345267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfd5fc91-19bb-4670-990e-f6ac7e6ad7f0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:01.352303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:01.353660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:01.354267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:01.354684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] PATH_INFO: `/v3/projects/e059b4be6be744f7a2cbdf7aa25257d6` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:01.356815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] RBAC: Authorizing `identity:delete_project(project_id=e059b4be6be744f7a2cbdf7aa25257d6)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:01.358904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:01.364483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:01.442737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e059b4be6be744f7a2cbdf7aa25257d6', 'request_id': 'req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:01.449710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e059b4be6be744f7a2cbdf7aa25257d6', 'request_id': 'req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:01.458012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e059b4be6be744f7a2cbdf7aa25257d6', 'request_id': 'req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:01.470954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] The token cache is being invalidate because project e059b4be6be744f7a2cbdf7aa25257d6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:39:01.471344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:01.472086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:01.473691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1136/2247] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:39:01 2022] DELETE /identity/v3/projects/e059b4be6be744f7a2cbdf7aa25257d6 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:39:03.228266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d7061-169d-4734-b323-64d9f0c70a3d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:03.228744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d7061-169d-4734-b323-64d9f0c70a3d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:03.228872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d9d7061-169d-4734-b323-64d9f0c70a3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:03.246540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2d9d7061-169d-4734-b323-64d9f0c70a3d None None] MFA Rules not processed for user `060efd8407b3485eb67d4651006fc184`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:03.247767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2d9d7061-169d-4734-b323-64d9f0c70a3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:03.306127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1112/2248] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:39:03 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:06.286911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:06.288342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:06.353677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e27f4c2-5ffd-4b94-92ef-661bd556a63e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:06.357285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:06.357955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:06.358229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:06.358500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:06.360460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:06.435160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:06.436796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:06.446720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1137/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:39:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 160 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:39:13.298400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=28 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:16.442435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=73,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:19.806425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3854-2a34-4fc3-8ad8-3f86025cea6d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:19.806885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3854-2a34-4fc3-8ad8-3f86025cea6d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:19.806979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b9d3854-2a34-4fc3-8ad8-3f86025cea6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:19.824381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-3b9d3854-2a34-4fc3-8ad8-3f86025cea6d None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:19.825583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-3b9d3854-2a34-4fc3-8ad8-3f86025cea6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:19.879983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1113/2250] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:39:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:19.922196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:19.923589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:19.991156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fcc4507-e75d-4f55-b08d-a960c3bf59fd service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:19.996083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12515ad-3028-4949-ad12-98e563244e6f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:19.996716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12515ad-3028-4949-ad12-98e563244e6f service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:19.996991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12515ad-3028-4949-ad12-98e563244e6f service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:19.997261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12515ad-3028-4949-ad12-98e563244e6f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:20.005861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12515ad-3028-4949-ad12-98e563244e6f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:20.007463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12515ad-3028-4949-ad12-98e563244e6f service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:20.015327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1138/2251] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:39:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:39:20.527564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76bc5e-c677-4ae7-b1fd-e5f85a02c0c7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:20.527926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76bc5e-c677-4ae7-b1fd-e5f85a02c0c7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:20.528524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f76bc5e-c677-4ae7-b1fd-e5f85a02c0c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:20.548734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5f76bc5e-c677-4ae7-b1fd-e5f85a02c0c7 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:20.550201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5f76bc5e-c677-4ae7-b1fd-e5f85a02c0c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:20.559248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1114/2252] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 12 08:39:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:20.573160 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12515ad-3028-4949-ad12-98e563244e6f service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:20.584053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12515ad-3028-4949-ad12-98e563244e6f service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:20.589127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95420186-ae35-4996-9826-53c66d4fbd06 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:20.589902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95420186-ae35-4996-9826-53c66d4fbd06 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:20.590305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95420186-ae35-4996-9826-53c66d4fbd06 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:20.590671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95420186-ae35-4996-9826-53c66d4fbd06 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:20.600325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95420186-ae35-4996-9826-53c66d4fbd06 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:20.602115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95420186-ae35-4996-9826-53c66d4fbd06 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:20.612123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1139/2253] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:39:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:39:20.839105 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a776f-e9d8-46db-8535-48c0015452da None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:20.839581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a776f-e9d8-46db-8535-48c0015452da None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:20.839841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e11a776f-e9d8-46db-8535-48c0015452da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:20.858751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e11a776f-e9d8-46db-8535-48c0015452da None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:20.860123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e11a776f-e9d8-46db-8535-48c0015452da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:20.867600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1115/2254] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:39:20 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:20.880219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95420186-ae35-4996-9826-53c66d4fbd06 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:20.890816 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95420186-ae35-4996-9826-53c66d4fbd06 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:20.896539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1326-5232-49f6-b1e1-a0bf1ddfbd72 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:20.897161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1326-5232-49f6-b1e1-a0bf1ddfbd72 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:20.897466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1326-5232-49f6-b1e1-a0bf1ddfbd72 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:20.897741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf1326-5232-49f6-b1e1-a0bf1ddfbd72 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:20.905926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1326-5232-49f6-b1e1-a0bf1ddfbd72 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:20.907517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf1326-5232-49f6-b1e1-a0bf1ddfbd72 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:20.915754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1140/2255] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:39:20 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:39:21.246930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97532-c3a8-4c57-b25e-b7f3ccfb4419 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:21.247219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97532-c3a8-4c57-b25e-b7f3ccfb4419 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:21.247498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a97532-c3a8-4c57-b25e-b7f3ccfb4419 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:21.265599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-41a97532-c3a8-4c57-b25e-b7f3ccfb4419 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:21.266802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-41a97532-c3a8-4c57-b25e-b7f3ccfb4419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:21.274158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1116/2256] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 12 08:39:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:21.286762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1326-5232-49f6-b1e1-a0bf1ddfbd72 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:21.296984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf1326-5232-49f6-b1e1-a0bf1ddfbd72 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:21.302517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed835f68-132b-4027-9e5e-41012f55e38b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:21.303131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed835f68-132b-4027-9e5e-41012f55e38b service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:21.303408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed835f68-132b-4027-9e5e-41012f55e38b service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:21.303676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed835f68-132b-4027-9e5e-41012f55e38b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:21.311523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed835f68-132b-4027-9e5e-41012f55e38b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:21.313084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed835f68-132b-4027-9e5e-41012f55e38b service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:21.321544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1141/2257] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:39:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:39:23.496744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97532-c3a8-4c57-b25e-b7f3ccfb4419 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:23.498294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-41a97532-c3a8-4c57-b25e-b7f3ccfb4419 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:23.605571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f113d2-9c3a-405c-b07e-a006b053fb68 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:23.606423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f113d2-9c3a-405c-b07e-a006b053fb68 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:23.606900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f113d2-9c3a-405c-b07e-a006b053fb68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:23.607238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a97532-c3a8-4c57-b25e-b7f3ccfb4419 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:23.612138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:23.614694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:23.614997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:23.615264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] PATH_INFO: `/v3/users/53633e955f694d3ebe03c0ea018a7d62` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:23.617480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53633e955f694d3ebe03c0ea018a7d62)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:23.620086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:23.630957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-70f113d2-9c3a-405c-b07e-a006b053fb68 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:23.632215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-70f113d2-9c3a-405c-b07e-a006b053fb68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:23.640429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1142/2258] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:39:23 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:39:23.655781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f113d2-9c3a-405c-b07e-a006b053fb68 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:23.668780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f113d2-9c3a-405c-b07e-a006b053fb68 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:23.675106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d810a4f-a442-4008-91da-edb6a0d52a83 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:23.676509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810a4f-a442-4008-91da-edb6a0d52a83 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:23.676780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810a4f-a442-4008-91da-edb6a0d52a83 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:23.677283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d810a4f-a442-4008-91da-edb6a0d52a83 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:23.683276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53633e955f694d3ebe03c0ea018a7d62'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:23.688033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d810a4f-a442-4008-91da-edb6a0d52a83 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:23.690401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d810a4f-a442-4008-91da-edb6a0d52a83 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:23.701536 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1143/2259] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:39:23 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 08:39:23.715516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53633e955f694d3ebe03c0ea018a7d62'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:23.727045 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53633e955f694d3ebe03c0ea018a7d62'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:23.752561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53633e955f694d3ebe03c0ea018a7d62'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:23.754811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53633e955f694d3ebe03c0ea018a7d62'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:23.772840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1117/2260] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:39:23 2022] DELETE /identity/v3/users/53633e955f694d3ebe03c0ea018a7d62 => generated 0 bytes in 277 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:39:23.778983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d533-e50a-457d-aff3-8aaf65f88c2c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:23.781325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d533-e50a-457d-aff3-8aaf65f88c2c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:23.782948 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efe6d533-e50a-457d-aff3-8aaf65f88c2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:23.864084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-efe6d533-e50a-457d-aff3-8aaf65f88c2c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:23.865779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-efe6d533-e50a-457d-aff3-8aaf65f88c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:23.990000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1144/2261] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:39:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:24.078324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:24.081196 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:24.094920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:24.198562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7733dfe9-e4d8-469b-af55-8b9167c5ba88 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:24.202523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f470bce-f5e2-45cc-9c4c-a6f57602240a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:24.203187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f470bce-f5e2-45cc-9c4c-a6f57602240a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:24.203470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f470bce-f5e2-45cc-9c4c-a6f57602240a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:24.203747 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f470bce-f5e2-45cc-9c4c-a6f57602240a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:24.228698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f470bce-f5e2-45cc-9c4c-a6f57602240a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:24.232089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f470bce-f5e2-45cc-9c4c-a6f57602240a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:24.249813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1118/2262] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:39:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:39:24.920223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d533-e50a-457d-aff3-8aaf65f88c2c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:24.924003 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-efe6d533-e50a-457d-aff3-8aaf65f88c2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:24.964145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efe6d533-e50a-457d-aff3-8aaf65f88c2c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:24.984035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:24.984918 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:24.985200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:24.985499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] PATH_INFO: `/v3/projects/e6be39781cc544e8a597279ec2d8750b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:24.988697 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=e6be39781cc544e8a597279ec2d8750b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:24.991208 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:25.055990 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:25.084370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e6be39781cc544e8a597279ec2d8750b', 'request_id': 'req-a8e6ab04-1097-424d-afc7-ed15950747ec'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:25.094061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e6be39781cc544e8a597279ec2d8750b', 'request_id': 'req-a8e6ab04-1097-424d-afc7-ed15950747ec'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:25.109111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e6be39781cc544e8a597279ec2d8750b', 'request_id': 'req-a8e6ab04-1097-424d-afc7-ed15950747ec'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:25.135688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] The token cache is being invalidate because project e6be39781cc544e8a597279ec2d8750b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:39:25.135984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:25.137253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-a8e6ab04-1097-424d-afc7-ed15950747ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:39:25.150568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1145/2263] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:39:24 2022] DELETE /identity/v3/projects/e6be39781cc544e8a597279ec2d8750b => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:39:25.826707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb3c2-1c77-421e-9ba8-db3d07c5cadd None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:25.827390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb3c2-1c77-421e-9ba8-db3d07c5cadd None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:25.827513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3feb3c2-1c77-421e-9ba8-db3d07c5cadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:25.866022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d3feb3c2-1c77-421e-9ba8-db3d07c5cadd None None] MFA Rules not processed for user `1f06fc34d5b54e558aa31f5b8f4d5afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:25.871897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3feb3c2-1c77-421e-9ba8-db3d07c5cadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:25.954955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1119/2264] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:39:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:35.124537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=6,keystone:SELECT=14,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:35.942620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=49 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:39.626888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5f6a7-90ec-4548-93df-0650b963f5bc None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:39.627475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5f6a7-90ec-4548-93df-0650b963f5bc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:39.627475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63b5f6a7-90ec-4548-93df-0650b963f5bc None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:39.629820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1146/2265] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:39:39 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:39:39.635655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3387b69-5d46-4352-9617-af5d9a20a2d2 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:39.636160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3387b69-5d46-4352-9617-af5d9a20a2d2 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:39.636278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3387b69-5d46-4352-9617-af5d9a20a2d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:39.657237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d3387b69-5d46-4352-9617-af5d9a20a2d2 None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:39.658665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d3387b69-5d46-4352-9617-af5d9a20a2d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:39.731058 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1120/2266] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:39:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:39.742942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5f6a7-90ec-4548-93df-0650b963f5bc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:39.745038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-63b5f6a7-90ec-4548-93df-0650b963f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:39.816588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63b5f6a7-90ec-4548-93df-0650b963f5bc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:39.821084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7590df0f-b057-4890-a7a0-33d45c7f014b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993e107cc04e4ce6b9abd9997c29381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:39.822115 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590df0f-b057-4890-a7a0-33d45c7f014b service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:39.822641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590df0f-b057-4890-a7a0-33d45c7f014b service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:39.823143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7590df0f-b057-4890-a7a0-33d45c7f014b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:39.835301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590df0f-b057-4890-a7a0-33d45c7f014b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:39.836749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7590df0f-b057-4890-a7a0-33d45c7f014b service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:39.847870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1147/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:39:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:39:39.923056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe75c-65da-49c2-8911-43ffba2f143e None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:39.923362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe75c-65da-49c2-8911-43ffba2f143e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:39.923652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4fe75c-65da-49c2-8911-43ffba2f143e None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:39.925285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1121/2268] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:39:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:39:39.930072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e16e9-04de-4a2f-9dda-6c107bb6f639 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:39.930433 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e16e9-04de-4a2f-9dda-6c107bb6f639 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:39.930776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d4e16e9-04de-4a2f-9dda-6c107bb6f639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:39.949828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4d4e16e9-04de-4a2f-9dda-6c107bb6f639 None None] MFA Rules not processed for user `686a32aea0b945d9a76875110c8f84ca`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:39.951042 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4d4e16e9-04de-4a2f-9dda-6c107bb6f639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:40.007985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1148/2269] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:39:39 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:39:40.019518 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe75c-65da-49c2-8911-43ffba2f143e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:40.021345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-0f4fe75c-65da-49c2-8911-43ffba2f143e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:40.034846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4fe75c-65da-49c2-8911-43ffba2f143e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:40.038493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d7f3f9-7fe8-4923-bcab-bfbd29760a4a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:40.039128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f3f9-7fe8-4923-bcab-bfbd29760a4a service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:40.039410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f3f9-7fe8-4923-bcab-bfbd29760a4a service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:40.039682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d7f3f9-7fe8-4923-bcab-bfbd29760a4a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:40.046831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7f3f9-7fe8-4923-bcab-bfbd29760a4a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:40.048464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d7f3f9-7fe8-4923-bcab-bfbd29760a4a service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:40.056984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1122/2270] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:39:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:39:40.145757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d12d0-fa72-44ff-9cbb-0e19bc03b5c2 None None] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:40.146154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d12d0-fa72-44ff-9cbb-0e19bc03b5c2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:40.146527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce6d12d0-fa72-44ff-9cbb-0e19bc03b5c2 None None] PATH_INFO: `/` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:40.148012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1149/2271] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:39:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 12 08:39:40.154122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba8ebf-b94a-4cc1-8f98-0c74c21200a0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:40.154526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba8ebf-b94a-4cc1-8f98-0c74c21200a0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:40.154776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beba8ebf-b94a-4cc1-8f98-0c74c21200a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:40.173352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-beba8ebf-b94a-4cc1-8f98-0c74c21200a0 None None] MFA Rules not processed for user `1fe88851e1154cf0838e0cbe47459156`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:40.174602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-beba8ebf-b94a-4cc1-8f98-0c74c21200a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:40.184453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1123/2272] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:39:40 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:40.196322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d12d0-fa72-44ff-9cbb-0e19bc03b5c2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:40.209111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce6d12d0-fa72-44ff-9cbb-0e19bc03b5c2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:40.212660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:40.213289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:40.213602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:40.213873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:40.225530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:40.227010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:40.239229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1150/2273] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:39:40 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:39:43.183565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49868c-2e59-4a85-bbb8-cbbb3bb64c5d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:43.184032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49868c-2e59-4a85-bbb8-cbbb3bb64c5d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:43.184142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d49868c-2e59-4a85-bbb8-cbbb3bb64c5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:43.201679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8d49868c-2e59-4a85-bbb8-cbbb3bb64c5d None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:39:43.202775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8d49868c-2e59-4a85-bbb8-cbbb3bb64c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:43.256269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1124/2274] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:39:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:39:43.267863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:43.269278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:43.336323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224f9bb4-f2e7-40bb-ab05-67ee2dd87165 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:43.341197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c27a6726-e2f7-4a9d-bac5-9bdeb52fb5b8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:43.341863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6726-e2f7-4a9d-bac5-9bdeb52fb5b8 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:43.342140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6726-e2f7-4a9d-bac5-9bdeb52fb5b8 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:43.342402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c27a6726-e2f7-4a9d-bac5-9bdeb52fb5b8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:43.351259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a6726-e2f7-4a9d-bac5-9bdeb52fb5b8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:43.352898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c27a6726-e2f7-4a9d-bac5-9bdeb52fb5b8 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:43.360802 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1151/2275] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:39:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:39:53.249118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=65 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:53.357714 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=87 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:39:56.497569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49868c-2e59-4a85-bbb8-cbbb3bb64c5d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:39:56.498982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8d49868c-2e59-4a85-bbb8-cbbb3bb64c5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:56.566140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d49868c-2e59-4a85-bbb8-cbbb3bb64c5d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:39:56.571753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:39:56.572387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:39:56.572673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:39:56.572955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:39:56.574702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:39:56.585887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:39:56.587471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:39:56.597893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1125/2276] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:39:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:40:06.593377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=32 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:40:09.643868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5990-e106-4e69-bc50-0a99fc730860 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:40:09.644390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5990-e106-4e69-bc50-0a99fc730860 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:40:09.644497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-981d5990-e106-4e69-bc50-0a99fc730860 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:40:09.662584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-981d5990-e106-4e69-bc50-0a99fc730860 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:40:09.663788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-981d5990-e106-4e69-bc50-0a99fc730860 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:40:09.670814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1152/2277] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 12 08:40:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:40:09.683213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:40:09.694920 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-685ae2ad-365b-4bf0-8b4a-513c687fbf47 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:40:09.699890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6a979c2-15f4-404f-b182-c32ddfedeeae service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:40:09.700528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a979c2-15f4-404f-b182-c32ddfedeeae service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:40:09.700807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a979c2-15f4-404f-b182-c32ddfedeeae service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:40:09.701081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6a979c2-15f4-404f-b182-c32ddfedeeae service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:40:09.710664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a979c2-15f4-404f-b182-c32ddfedeeae service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:40:09.712289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6a979c2-15f4-404f-b182-c32ddfedeeae service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:40:09.720687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1126/2278] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:40:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:40:19.657486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:40:19.717043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:40:33.506520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86488723-168a-45d1-a2e3-b35c126e78bb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:40:33.507030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86488723-168a-45d1-a2e3-b35c126e78bb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:40:33.507136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86488723-168a-45d1-a2e3-b35c126e78bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:40:33.524614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-86488723-168a-45d1-a2e3-b35c126e78bb None None] MFA Rules not processed for user `060efd8407b3485eb67d4651006fc184`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:40:33.525970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-86488723-168a-45d1-a2e3-b35c126e78bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:40:33.583253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1153/2279] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:40:33 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:40:43.576584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=25 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:40:52.013573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46570c-c97d-4781-8376-893970a592dc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:40:52.014368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46570c-c97d-4781-8376-893970a592dc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:40:52.014653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e46570c-c97d-4781-8376-893970a592dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:40:52.032953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2e46570c-c97d-4781-8376-893970a592dc None None] MFA Rules not processed for user `1f06fc34d5b54e558aa31f5b8f4d5afa`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:40:52.034197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e46570c-c97d-4781-8376-893970a592dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:40:52.041816 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1127/2280] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:40:52 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:41:01.578882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e842b6d-8dc0-45e5-ba1c-5fc65468360b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:01.579365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e842b6d-8dc0-45e5-ba1c-5fc65468360b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:01.579756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e842b6d-8dc0-45e5-ba1c-5fc65468360b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:01.597209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8e842b6d-8dc0-45e5-ba1c-5fc65468360b None None] MFA Rules not processed for user `0a028c1d97ce4951bdbb707b772baffe`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:41:01.599029 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8e842b6d-8dc0-45e5-ba1c-5fc65468360b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:01.655706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1154/2281] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:41:01 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:41:02.027320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:41:11.648497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=25 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:41:14.805997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b731c-a522-48e4-a9f5-f033c3a450d5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:14.806528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b731c-a522-48e4-a9f5-f033c3a450d5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:14.806528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b731c-a522-48e4-a9f5-f033c3a450d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:14.823759 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-355b731c-a522-48e4-a9f5-f033c3a450d5 None None] MFA Rules not processed for user `e037c38a998240b293910049cfe37799`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:41:14.824876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-355b731c-a522-48e4-a9f5-f033c3a450d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:14.878098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1128/2282] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:41:14 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:41:24.871463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=25 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:41:38.203905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e842b6d-8dc0-45e5-ba1c-5fc65468360b None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:41:38.213933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e842b6d-8dc0-45e5-ba1c-5fc65468360b None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:41:38.217404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfc1a13-50ed-442f-8a98-649c48562e70 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:41:38.218067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc1a13-50ed-442f-8a98-649c48562e70 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:38.218344 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc1a13-50ed-442f-8a98-649c48562e70 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:38.218617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfc1a13-50ed-442f-8a98-649c48562e70 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:38.220356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ebfc1a13-50ed-442f-8a98-649c48562e70 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:38.234174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc1a13-50ed-442f-8a98-649c48562e70 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:41:38.235608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfc1a13-50ed-442f-8a98-649c48562e70 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:41:38.246271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1155/2283] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:41:38 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:41:41.802551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b731c-a522-48e4-a9f5-f033c3a450d5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:41:41.804534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-355b731c-a522-48e4-a9f5-f033c3a450d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:41.816067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b731c-a522-48e4-a9f5-f033c3a450d5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:41:41.820153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:41:41.820772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:41.821046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:41.821317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:41.823060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:41.836501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:41:41.837946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:41:41.848620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1129/2284] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:41:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:41:48.242202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:41:51.843860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:41:54.590548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db814-6ae5-44dc-bcf2-c71444f03015 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:54.591091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db814-6ae5-44dc-bcf2-c71444f03015 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:54.591091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083db814-6ae5-44dc-bcf2-c71444f03015 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:54.610785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-083db814-6ae5-44dc-bcf2-c71444f03015 None None] MFA Rules not processed for user `060efd8407b3485eb67d4651006fc184`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:41:54.612149 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-083db814-6ae5-44dc-bcf2-c71444f03015 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:54.622023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1156/2285] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:41:54 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:41:57.283940 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:41:57.285406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:57.298786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bdcec7-fe8e-48ed-b429-e0f38bba89dd service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:41:57.304685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:41:57.305302 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:57.305615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:57.305888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:57.307572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:57.317402 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:41:57.318975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:41:57.328479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1130/2286] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:41:57 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:41:57.850039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db814-6ae5-44dc-bcf2-c71444f03015 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:41:57.863490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083db814-6ae5-44dc-bcf2-c71444f03015 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:41:57.869054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:41:57.869979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:57.870263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:57.870582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:57.872370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:57.882846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:41:57.884404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:41:57.893149 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1157/2287] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:41:57 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:41:58.506474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:41:58.508491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:58.524174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bee0790-3cf6-405b-a740-35b20e87db00 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:41:58.530665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:41:58.531587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:58.532076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:58.532421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:58.534409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:41:58.535720 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:41:58.545459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:41:58.547322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcf7df6-0b25-4b48-a31f-24ac33c8c856 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:41:58.547487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:41:58.551438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:41:58.552559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:41:58.553001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:41:58.554156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:41:58.559090 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1131/2288] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:41:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:41:58.566646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:41:58.568475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:41:58.581515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1158/2289] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:41:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:06.620442 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:06.629777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fadebb38-1b6b-4a81-b9ff-d548bd2f3e1a service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:06.633310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:06.633977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:06.634256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:06.634531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:06.636273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:06.697909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:06.699251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:06.708893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1132/2290] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:08.575660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=15 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:10.168170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:10.169830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:10.188592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64073d6-7d09-4ff1-ae65-e925ddebcf25 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:10.193650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:10.195019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.195296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.195570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] PATH_INFO: `/v3/users/1f06fc34d5b54e558aa31f5b8f4d5afa` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.196758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1f06fc34d5b54e558aa31f5b8f4d5afa)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:10.198907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:10.258236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1f06fc34d5b54e558aa31f5b8f4d5afa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.260346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1f06fc34d5b54e558aa31f5b8f4d5afa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.268783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1f06fc34d5b54e558aa31f5b8f4d5afa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.281304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1f06fc34d5b54e558aa31f5b8f4d5afa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.281988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-ddfc2572-41a0-42a6-a5f3-546d72765d48 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1f06fc34d5b54e558aa31f5b8f4d5afa'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.288455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1159/2291] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:10 2022] DELETE /identity/v3/users/1f06fc34d5b54e558aa31f5b8f4d5afa => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:10.458259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:10.470801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e7244b-2a56-4420-a366-ceeec95b515c service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:10.533410 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:10.534297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.534579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.534854 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] PATH_INFO: `/v3/projects/7dd85fa6fcbf4339874460bc50a0c5c5` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.536037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7dd85fa6fcbf4339874460bc50a0c5c5)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:10.538281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:10.586638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7dd85fa6fcbf4339874460bc50a0c5c5', 'request_id': 'req-c424ef88-fb5c-4e08-b561-688d1fbc16e6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.592519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7dd85fa6fcbf4339874460bc50a0c5c5', 'request_id': 'req-c424ef88-fb5c-4e08-b561-688d1fbc16e6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.600328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7dd85fa6fcbf4339874460bc50a0c5c5', 'request_id': 'req-c424ef88-fb5c-4e08-b561-688d1fbc16e6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.608257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:10.613051 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] The token cache is being invalidate because project 7dd85fa6fcbf4339874460bc50a0c5c5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:10.613706 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.614352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c424ef88-fb5c-4e08-b561-688d1fbc16e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:10.616959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1133/2292] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:10 2022] DELETE /identity/v3/projects/7dd85fa6fcbf4339874460bc50a0c5c5 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:10.622144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28219f-c07f-495f-b2bf-9cb3ebe56b5e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.622431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28219f-c07f-495f-b2bf-9cb3ebe56b5e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.622713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb28219f-c07f-495f-b2bf-9cb3ebe56b5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.641215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-eb28219f-c07f-495f-b2bf-9cb3ebe56b5e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:10.642384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-eb28219f-c07f-495f-b2bf-9cb3ebe56b5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:10.701497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1160/2293] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:10.709099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ccd60-dfbc-4f14-ae19-2ce8f433ba81 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.710654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ccd60-dfbc-4f14-ae19-2ce8f433ba81 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.710654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-337ccd60-dfbc-4f14-ae19-2ce8f433ba81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.730233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-337ccd60-dfbc-4f14-ae19-2ce8f433ba81 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:10.731599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-337ccd60-dfbc-4f14-ae19-2ce8f433ba81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:10.740510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1134/2294] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:42:10.744854 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28219f-c07f-495f-b2bf-9cb3ebe56b5e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:10.754701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb28219f-c07f-495f-b2bf-9cb3ebe56b5e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:10.759448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:10.760147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.760468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.760821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.761704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:42:10.762454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:10.763651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:10.776281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1161/2295] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:42:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:42:10.780953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ccd60-dfbc-4f14-ae19-2ce8f433ba81 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:10.791010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-337ccd60-dfbc-4f14-ae19-2ce8f433ba81 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:10.795670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e7136-4366-47e4-a3c0-fdda77cb4649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:10.796315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e7136-4366-47e4-a3c0-fdda77cb4649 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.796593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e7136-4366-47e4-a3c0-fdda77cb4649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.796982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574e7136-4366-47e4-a3c0-fdda77cb4649 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.797739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e7136-4366-47e4-a3c0-fdda77cb4649 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:10.799948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574e7136-4366-47e4-a3c0-fdda77cb4649 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:10.827924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1135/2296] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:10 2022] POST /identity/v3/projects => generated 365 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:42:10.831996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:10.842916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda58aef-f7e2-48a4-bd36-360cbf9e370c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:10.899844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4d852-0bc4-4411-9999-ef256f42f48e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:10.900420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d852-0bc4-4411-9999-ef256f42f48e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.900696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d852-0bc4-4411-9999-ef256f42f48e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.900965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df4d852-0bc4-4411-9999-ef256f42f48e admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.901672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4d852-0bc4-4411-9999-ef256f42f48e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:10.903839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df4d852-0bc4-4411-9999-ef256f42f48e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:10.910296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:10.925229 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1162/2297] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:10 2022] POST /identity/v3/users => generated 283 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:10.930060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e7136-4366-47e4-a3c0-fdda77cb4649 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:10.940580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574e7136-4366-47e4-a3c0-fdda77cb4649 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:10.945917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3628e3-2aef-44bb-b534-360ec61559cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:10.946573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3628e3-2aef-44bb-b534-360ec61559cc admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.946855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3628e3-2aef-44bb-b534-360ec61559cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.947133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e3628e3-2aef-44bb-b534-360ec61559cc admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.947852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3628e3-2aef-44bb-b534-360ec61559cc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:10.949473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e3628e3-2aef-44bb-b534-360ec61559cc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:10.960864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1136/2298] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:10.964820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4d852-0bc4-4411-9999-ef256f42f48e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:10.974454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df4d852-0bc4-4411-9999-ef256f42f48e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:10.979663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2ce6eeb-7fb4-4890-93d0-8f83a8b7677c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:10.980304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce6eeb-7fb4-4890-93d0-8f83a8b7677c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:10.980580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce6eeb-7fb4-4890-93d0-8f83a8b7677c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:10.980849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2ce6eeb-7fb4-4890-93d0-8f83a8b7677c admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:10.981596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce6eeb-7fb4-4890-93d0-8f83a8b7677c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:10.983166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2ce6eeb-7fb4-4890-93d0-8f83a8b7677c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:10.994108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1163/2299] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:10 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:10.998036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3628e3-2aef-44bb-b534-360ec61559cc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:11.007971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e3628e3-2aef-44bb-b534-360ec61559cc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:11.012522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:11.013386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:11.013701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:11.013977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] PATH_INFO: `/v3/projects/c9a2cfbddcd043afacb3a2e6d17710f3/users/52dd26f0a92c4e9e95be6b5ec3522b37/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:11.028560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c9a2cfbddcd043afacb3a2e6d17710f3, user_id=52dd26f0a92c4e9e95be6b5ec3522b37, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:11.031343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:11.044509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1137/2300] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:10 2022] PUT /identity/v3/projects/c9a2cfbddcd043afacb3a2e6d17710f3/users/52dd26f0a92c4e9e95be6b5ec3522b37/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:11.056358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b557e6-928d-4a07-a054-7798e6253b66 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:11.056648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b557e6-928d-4a07-a054-7798e6253b66 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:11.056928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02b557e6-928d-4a07-a054-7798e6253b66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:11.082569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-02b557e6-928d-4a07-a054-7798e6253b66 None None] MFA Rules not processed for user `52dd26f0a92c4e9e95be6b5ec3522b37`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:11.083762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-02b557e6-928d-4a07-a054-7798e6253b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:11.147726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1164/2301] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:11 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:11.159174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:11.160846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:11.218224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5a95a6d-f59a-44bd-a784-35892a417e23 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:11.221853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:11.222488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:11.222772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:11.223046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:11.232896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:11.234831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:11.244684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1138/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:11 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:42:11.810866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b557e6-928d-4a07-a054-7798e6253b66 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:11.813116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-02b557e6-928d-4a07-a054-7798e6253b66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:11.888141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02b557e6-928d-4a07-a054-7798e6253b66 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:11.893680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e805eb8-88de-48ec-b3f1-4cbe670ac3fd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:11.894321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805eb8-88de-48ec-b3f1-4cbe670ac3fd service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:11.894603 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805eb8-88de-48ec-b3f1-4cbe670ac3fd service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:11.894878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e805eb8-88de-48ec-b3f1-4cbe670ac3fd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:11.896655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3e805eb8-88de-48ec-b3f1-4cbe670ac3fd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:11.970825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e805eb8-88de-48ec-b3f1-4cbe670ac3fd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:11.979269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e805eb8-88de-48ec-b3f1-4cbe670ac3fd service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:11.992884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1165/2303] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:14.117439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:14.119034 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:14.188695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-185173f1-93e7-44d3-b5af-97b6536633b6 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:14.192765 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:14.194406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:14.194766 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:14.195195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:14.197682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:14.208507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:14.210894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:14.237330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1139/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:14 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:18.178428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e4398-3cf6-4397-9fe4-916377e85243 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:18.179234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e4398-3cf6-4397-9fe4-916377e85243 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:18.179531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680e4398-3cf6-4397-9fe4-916377e85243 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:18.187408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:18.203447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-680e4398-3cf6-4397-9fe4-916377e85243 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:18.204738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-680e4398-3cf6-4397-9fe4-916377e85243 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:18.263850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1166/2305] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:42:18 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:18.313820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:18.315492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:18.359159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:18.389005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81ea29f3-376c-497f-ae4b-579cc4367ae0 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:18.393975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9d30cf1-d3bf-4fe3-9b9d-d2167287da67 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:18.394642 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d30cf1-d3bf-4fe3-9b9d-d2167287da67 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:18.394921 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d30cf1-d3bf-4fe3-9b9d-d2167287da67 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:18.395195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d30cf1-d3bf-4fe3-9b9d-d2167287da67 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:18.403831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d30cf1-d3bf-4fe3-9b9d-d2167287da67 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:18.405411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9d30cf1-d3bf-4fe3-9b9d-d2167287da67 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:18.414775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1140/2306] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:42:18 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:42:19.787872 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e4398-3cf6-4397-9fe4-916377e85243 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:19.858367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680e4398-3cf6-4397-9fe4-916377e85243 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:19.863808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:19.864916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:19.865209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:19.866077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] PATH_INFO: `/v3/users/52dd26f0a92c4e9e95be6b5ec3522b37` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:19.867343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=52dd26f0a92c4e9e95be6b5ec3522b37)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:19.869387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:19.923893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '52dd26f0a92c4e9e95be6b5ec3522b37'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:19.933620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '52dd26f0a92c4e9e95be6b5ec3522b37'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:19.946312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '52dd26f0a92c4e9e95be6b5ec3522b37'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:19.966389 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '52dd26f0a92c4e9e95be6b5ec3522b37'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:19.967294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '52dd26f0a92c4e9e95be6b5ec3522b37'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:19.977634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1167/2307] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:19 2022] DELETE /identity/v3/users/52dd26f0a92c4e9e95be6b5ec3522b37 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:19.982481 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbc7b-fa04-437a-8e18-f11822a84831 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:19.983448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbc7b-fa04-437a-8e18-f11822a84831 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:19.983731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1acfbc7b-fa04-437a-8e18-f11822a84831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:20.014126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1acfbc7b-fa04-437a-8e18-f11822a84831 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:20.015462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1acfbc7b-fa04-437a-8e18-f11822a84831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:20.089496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1141/2308] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:20.096666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:20.098916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:20.152393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:20.189285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e0ca71-f87d-4748-9193-1ada47da5fd9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:20.193103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d84d6d-c463-4d55-a2d4-2db72b03ed2f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:20.193806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d84d6d-c463-4d55-a2d4-2db72b03ed2f service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:20.194093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d84d6d-c463-4d55-a2d4-2db72b03ed2f service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:20.194363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d84d6d-c463-4d55-a2d4-2db72b03ed2f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:20.207276 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d84d6d-c463-4d55-a2d4-2db72b03ed2f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:20.209046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d84d6d-c463-4d55-a2d4-2db72b03ed2f service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:20.219372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1168/2309] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:20.595727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfbc7b-fa04-437a-8e18-f11822a84831 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:20.597398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1acfbc7b-fa04-437a-8e18-f11822a84831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:20.626509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1acfbc7b-fa04-437a-8e18-f11822a84831 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:20.635244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:20.636413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:20.636705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:20.636983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] PATH_INFO: `/v3/projects/c9a2cfbddcd043afacb3a2e6d17710f3` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:20.638336 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c9a2cfbddcd043afacb3a2e6d17710f3)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:20.640303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:20.705735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c9a2cfbddcd043afacb3a2e6d17710f3', 'request_id': 'req-9aaf3c12-2689-4a55-b48b-0c466993b024'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:20.712638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c9a2cfbddcd043afacb3a2e6d17710f3', 'request_id': 'req-9aaf3c12-2689-4a55-b48b-0c466993b024'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:20.725592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c9a2cfbddcd043afacb3a2e6d17710f3', 'request_id': 'req-9aaf3c12-2689-4a55-b48b-0c466993b024'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:20.740042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] The token cache is being invalidate because project c9a2cfbddcd043afacb3a2e6d17710f3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:20.740931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:20.741980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9aaf3c12-2689-4a55-b48b-0c466993b024 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:20.743717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1142/2310] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:20 2022] DELETE /identity/v3/projects/c9a2cfbddcd043afacb3a2e6d17710f3 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:20.748670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67807-84de-46c7-8d3b-b229b2781b29 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:20.748979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67807-84de-46c7-8d3b-b229b2781b29 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:20.749259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ca67807-84de-46c7-8d3b-b229b2781b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:20.773025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2ca67807-84de-46c7-8d3b-b229b2781b29 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:20.774525 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2ca67807-84de-46c7-8d3b-b229b2781b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:20.848997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1169/2311] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:20.854772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f320f-421e-4f3b-8d6c-0a946796c665 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:20.855283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f320f-421e-4f3b-8d6c-0a946796c665 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:20.855660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-721f320f-421e-4f3b-8d6c-0a946796c665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:20.876895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-721f320f-421e-4f3b-8d6c-0a946796c665 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:20.878475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-721f320f-421e-4f3b-8d6c-0a946796c665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:20.888908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1143/2312] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:20.892953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca67807-84de-46c7-8d3b-b229b2781b29 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:20.903965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ca67807-84de-46c7-8d3b-b229b2781b29 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:20.912900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:20.913709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:20.913969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:20.914237 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:20.914964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:42:20.915261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:20.916870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:20.933944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1170/2313] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:42:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:42:20.938019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f320f-421e-4f3b-8d6c-0a946796c665 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:20.948242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-721f320f-421e-4f3b-8d6c-0a946796c665 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:20.953309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ae8ca-68a8-45ef-9533-ff43d13f1afc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:20.954076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ae8ca-68a8-45ef-9533-ff43d13f1afc admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:20.954445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ae8ca-68a8-45ef-9533-ff43d13f1afc admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:20.954792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f98ae8ca-68a8-45ef-9533-ff43d13f1afc admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:20.955823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ae8ca-68a8-45ef-9533-ff43d13f1afc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:20.957840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f98ae8ca-68a8-45ef-9533-ff43d13f1afc admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:20.996662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1144/2314] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:20 2022] POST /identity/v3/projects => generated 381 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:42:20.998041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.009245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55561c2b-e563-45e6-8c8e-a023b4e0856d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:21.082467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0f13-a078-462d-b305-0b62c5b55e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:21.083152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0f13-a078-462d-b305-0b62c5b55e4a admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.083430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0f13-a078-462d-b305-0b62c5b55e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.083701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-688b0f13-a078-462d-b305-0b62c5b55e4a admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.085162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b0f13-a078-462d-b305-0b62c5b55e4a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:21.087197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-688b0f13-a078-462d-b305-0b62c5b55e4a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:21.147319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1171/2315] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:20 2022] POST /identity/v3/users => generated 291 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:21.151755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ae8ca-68a8-45ef-9533-ff43d13f1afc admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.165551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f98ae8ca-68a8-45ef-9533-ff43d13f1afc admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:21.171200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabda3f-cd54-4723-9815-8ea58bc9ee71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:21.171826 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabda3f-cd54-4723-9815-8ea58bc9ee71 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.172134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabda3f-cd54-4723-9815-8ea58bc9ee71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.172409 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fabda3f-cd54-4723-9815-8ea58bc9ee71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.173158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabda3f-cd54-4723-9815-8ea58bc9ee71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:21.174866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fabda3f-cd54-4723-9815-8ea58bc9ee71 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:21.189459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1145/2316] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:21.192130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0f13-a078-462d-b305-0b62c5b55e4a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.214669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-688b0f13-a078-462d-b305-0b62c5b55e4a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:21.219549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c3713a-b2b7-4afe-8a58-914965139ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:21.220352 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3713a-b2b7-4afe-8a58-914965139ddd admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.220759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3713a-b2b7-4afe-8a58-914965139ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.221176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c3713a-b2b7-4afe-8a58-914965139ddd admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.222190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3713a-b2b7-4afe-8a58-914965139ddd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:21.224037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41c3713a-b2b7-4afe-8a58-914965139ddd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:21.240891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1172/2317] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:21.244866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabda3f-cd54-4723-9815-8ea58bc9ee71 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.261391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fabda3f-cd54-4723-9815-8ea58bc9ee71 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:21.271117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c849-421f-4fad-9207-fef5c7089152 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:21.272754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c849-421f-4fad-9207-fef5c7089152 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.273222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c849-421f-4fad-9207-fef5c7089152 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.273765 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0464c849-421f-4fad-9207-fef5c7089152 admin admin] PATH_INFO: `/v3/projects/bf0464c3a0394d76950fb3feeb74c077/users/a30daf99db374744b53553a9d35c7144/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.289510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:21.296987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c849-421f-4fad-9207-fef5c7089152 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf0464c3a0394d76950fb3feeb74c077, user_id=a30daf99db374744b53553a9d35c7144, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:21.300176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0464c849-421f-4fad-9207-fef5c7089152 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:21.321676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1146/2318] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:21 2022] PUT /identity/v3/projects/bf0464c3a0394d76950fb3feeb74c077/users/a30daf99db374744b53553a9d35c7144/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:21.337745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e75ef-c4e3-4b0f-b328-d466ee728d76 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.338072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e75ef-c4e3-4b0f-b328-d466ee728d76 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.338412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2e75ef-c4e3-4b0f-b328-d466ee728d76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.372002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1d2e75ef-c4e3-4b0f-b328-d466ee728d76 None None] MFA Rules not processed for user `a30daf99db374744b53553a9d35c7144`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:21.373347 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1d2e75ef-c4e3-4b0f-b328-d466ee728d76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:21.414934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:21.483031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1173/2319] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:21.487419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c849-421f-4fad-9207-fef5c7089152 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.563600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0464c849-421f-4fad-9207-fef5c7089152 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:21.570515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252bb77-1e39-4599-a8d6-8b9629309665 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:21.571184 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252bb77-1e39-4599-a8d6-8b9629309665 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.571467 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252bb77-1e39-4599-a8d6-8b9629309665 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.571742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8252bb77-1e39-4599-a8d6-8b9629309665 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.572623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252bb77-1e39-4599-a8d6-8b9629309665 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:21.574774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8252bb77-1e39-4599-a8d6-8b9629309665 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:21.616240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1147/2320] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:21 2022] POST /identity/v3/projects => generated 379 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:21.617625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e75ef-c4e3-4b0f-b328-d466ee728d76 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.666008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2e75ef-c4e3-4b0f-b328-d466ee728d76 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:21.789628 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1572dd7-7c4c-4b31-b23d-48f5852d18e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:21.790320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572dd7-7c4c-4b31-b23d-48f5852d18e0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.790597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572dd7-7c4c-4b31-b23d-48f5852d18e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.790869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1572dd7-7c4c-4b31-b23d-48f5852d18e0 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.791579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1572dd7-7c4c-4b31-b23d-48f5852d18e0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:21.793541 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1572dd7-7c4c-4b31-b23d-48f5852d18e0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:21.826346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252bb77-1e39-4599-a8d6-8b9629309665 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.827329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1174/2321] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:21 2022] POST /identity/v3/users => generated 296 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:42:21.839915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8252bb77-1e39-4599-a8d6-8b9629309665 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:21.844585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102c699-3e0a-4c88-8b54-8087a5d511c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:21.845244 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102c699-3e0a-4c88-8b54-8087a5d511c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.845576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102c699-3e0a-4c88-8b54-8087a5d511c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.845873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e102c699-3e0a-4c88-8b54-8087a5d511c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.846581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102c699-3e0a-4c88-8b54-8087a5d511c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:21.848304 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e102c699-3e0a-4c88-8b54-8087a5d511c7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:21.861553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1148/2322] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:42:21.864785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1572dd7-7c4c-4b31-b23d-48f5852d18e0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.875756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1572dd7-7c4c-4b31-b23d-48f5852d18e0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:21.883499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a3d23-93b4-4659-b196-ceafe306939b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:21.884400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3d23-93b4-4659-b196-ceafe306939b admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:21.884680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3d23-93b4-4659-b196-ceafe306939b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:21.884953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67a3d23-93b4-4659-b196-ceafe306939b admin admin] PATH_INFO: `/v3/projects/7deafb32a8bd46b5be76471b8ff51598/users/50622fdc4a9d4ad8a4fc93d53dbd5c2f/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:21.904850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a3d23-93b4-4659-b196-ceafe306939b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7deafb32a8bd46b5be76471b8ff51598, user_id=50622fdc4a9d4ad8a4fc93d53dbd5c2f, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:21.907561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67a3d23-93b4-4659-b196-ceafe306939b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:21.927862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1175/2323] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:21 2022] PUT /identity/v3/projects/7deafb32a8bd46b5be76471b8ff51598/users/50622fdc4a9d4ad8a4fc93d53dbd5c2f/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:21.929295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102c699-3e0a-4c88-8b54-8087a5d511c7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:21.943180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e102c699-3e0a-4c88-8b54-8087a5d511c7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:22.013014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6bd07e-eba7-4148-a38a-275ed57ca7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:22.013819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bd07e-eba7-4148-a38a-275ed57ca7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:22.014167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bd07e-eba7-4148-a38a-275ed57ca7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:22.014508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6bd07e-eba7-4148-a38a-275ed57ca7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:22.015310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bd07e-eba7-4148-a38a-275ed57ca7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:22.017011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6bd07e-eba7-4148-a38a-275ed57ca7ab admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:22.029671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1149/2324] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:21 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:22.033937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a3d23-93b4-4659-b196-ceafe306939b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:22.044841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67a3d23-93b4-4659-b196-ceafe306939b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:22.052199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:22.054147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:22.054764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:22.055200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] PATH_INFO: `/v3/projects/7deafb32a8bd46b5be76471b8ff51598/users/50622fdc4a9d4ad8a4fc93d53dbd5c2f/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:22.057601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7deafb32a8bd46b5be76471b8ff51598, user_id=50622fdc4a9d4ad8a4fc93d53dbd5c2f, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:22.060557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:22.076576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1176/2325] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:22 2022] PUT /identity/v3/projects/7deafb32a8bd46b5be76471b8ff51598/users/50622fdc4a9d4ad8a4fc93d53dbd5c2f/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:22.087603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4831d7-4b00-44df-9984-6c8b2e45b01f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:22.087603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4831d7-4b00-44df-9984-6c8b2e45b01f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:22.087974 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4831d7-4b00-44df-9984-6c8b2e45b01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:22.118538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8f4831d7-4b00-44df-9984-6c8b2e45b01f None None] MFA Rules not processed for user `50622fdc4a9d4ad8a4fc93d53dbd5c2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:22.119823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8f4831d7-4b00-44df-9984-6c8b2e45b01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:22.174194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:22.208226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1150/2326] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:22 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:22.214231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:22.216332 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:22.291950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f5793b-a464-4f00-b920-9803998a89e1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:22.295588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:22.296268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:22.296551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:22.296824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:22.310152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:22.311643 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:22.322572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1177/2327] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:22 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:22.407522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4831d7-4b00-44df-9984-6c8b2e45b01f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:22.421848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4831d7-4b00-44df-9984-6c8b2e45b01f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:22.431292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65fbc-b1ec-4240-a407-5fcc283cbec0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:22.431985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65fbc-b1ec-4240-a407-5fcc283cbec0 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:22.432266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65fbc-b1ec-4240-a407-5fcc283cbec0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:22.432689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d65fbc-b1ec-4240-a407-5fcc283cbec0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:22.507457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d65fbc-b1ec-4240-a407-5fcc283cbec0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:22.508886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25d65fbc-b1ec-4240-a407-5fcc283cbec0 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:22.520986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1151/2328] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:22 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:31.702260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:31.704287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:31.735773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:31.787512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30f2036-ea4a-403a-92b7-7b83d016fb14 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:31.793598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1da4d1-a4c1-4b18-aeb1-2f4fb9709023 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:31.794315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da4d1-a4c1-4b18-aeb1-2f4fb9709023 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:31.794681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da4d1-a4c1-4b18-aeb1-2f4fb9709023 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:31.795022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1da4d1-a4c1-4b18-aeb1-2f4fb9709023 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:31.796982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ca1da4d1-a4c1-4b18-aeb1-2f4fb9709023 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:31.810310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1da4d1-a4c1-4b18-aeb1-2f4fb9709023 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:31.811925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1da4d1-a4c1-4b18-aeb1-2f4fb9709023 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:31.822518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1178/2329] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:31 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:32.515670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=35 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:32.746535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65fbc-b1ec-4240-a407-5fcc283cbec0 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:32.807226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d65fbc-b1ec-4240-a407-5fcc283cbec0 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:32.811707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:32.812561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:32.812838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:32.813109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] PATH_INFO: `/v3/users/a30daf99db374744b53553a9d35c7144` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:32.814323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a30daf99db374744b53553a9d35c7144)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:32.816229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:32.870632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a30daf99db374744b53553a9d35c7144'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:32.884139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a30daf99db374744b53553a9d35c7144'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:32.892275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a30daf99db374744b53553a9d35c7144'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:32.901719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a30daf99db374744b53553a9d35c7144'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:32.902600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a30daf99db374744b53553a9d35c7144'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:32.908999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1152/2330] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:32 2022] DELETE /identity/v3/users/a30daf99db374744b53553a9d35c7144 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:32.915688 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa00b1-93e2-48aa-807a-df1834b1146e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:32.916184 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa00b1-93e2-48aa-807a-df1834b1146e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:32.916303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3aaa00b1-93e2-48aa-807a-df1834b1146e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:32.935534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3aaa00b1-93e2-48aa-807a-df1834b1146e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:32.936844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3aaa00b1-93e2-48aa-807a-df1834b1146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:33.012644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1179/2331] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:33.023663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:33.025972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:33.091949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b43053-fbb1-4520-b9ef-fc42f64e3a78 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:33.098728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c4a7-bfbd-453b-922f-a5ca5f1ad79f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:33.099927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c4a7-bfbd-453b-922f-a5ca5f1ad79f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:33.100445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c4a7-bfbd-453b-922f-a5ca5f1ad79f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:33.100744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc04c4a7-bfbd-453b-922f-a5ca5f1ad79f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:33.113310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c4a7-bfbd-453b-922f-a5ca5f1ad79f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:33.116340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc04c4a7-bfbd-453b-922f-a5ca5f1ad79f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:33.127407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1153/2332] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:33.469519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa00b1-93e2-48aa-807a-df1834b1146e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:33.471011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3aaa00b1-93e2-48aa-807a-df1834b1146e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:33.484156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3aaa00b1-93e2-48aa-807a-df1834b1146e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:33.489539 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:33.491120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:33.491401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:33.491673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] PATH_INFO: `/v3/projects/bf0464c3a0394d76950fb3feeb74c077` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:33.492896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf0464c3a0394d76950fb3feeb74c077)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:33.494863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:33.546993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf0464c3a0394d76950fb3feeb74c077', 'request_id': 'req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.554285 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf0464c3a0394d76950fb3feeb74c077', 'request_id': 'req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.563194 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf0464c3a0394d76950fb3feeb74c077', 'request_id': 'req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.574310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] The token cache is being invalidate because project bf0464c3a0394d76950fb3feeb74c077 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:33.574595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.575322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.576869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1180/2333] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:33 2022] DELETE /identity/v3/projects/bf0464c3a0394d76950fb3feeb74c077 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:42:33.581209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c4a7-bfbd-453b-922f-a5ca5f1ad79f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:33.598205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc04c4a7-bfbd-453b-922f-a5ca5f1ad79f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:33.626718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:33.674736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:33.675975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:33.676443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:33.676875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] PATH_INFO: `/v3/users/50622fdc4a9d4ad8a4fc93d53dbd5c2f` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:33.679038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50622fdc4a9d4ad8a4fc93d53dbd5c2f)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:33.681232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:33.739451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50622fdc4a9d4ad8a4fc93d53dbd5c2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.760007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50622fdc4a9d4ad8a4fc93d53dbd5c2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.771963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50622fdc4a9d4ad8a4fc93d53dbd5c2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.780123 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50622fdc4a9d4ad8a4fc93d53dbd5c2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.781764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-740ca564-b210-46bb-8d68-29d2f0a45b73 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50622fdc4a9d4ad8a4fc93d53dbd5c2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:33.790377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1154/2334] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:33 2022] DELETE /identity/v3/users/50622fdc4a9d4ad8a4fc93d53dbd5c2f => generated 0 bytes in 210 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:42:34.087701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:34.089878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:34.106117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e5e9cc-ea66-47ef-8b7f-a0e258da385e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:34.139190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:34.173569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:34.174452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.174713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.174986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] PATH_INFO: `/v3/projects/7deafb32a8bd46b5be76471b8ff51598` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.176162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7deafb32a8bd46b5be76471b8ff51598)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:34.178210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:34.229251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7deafb32a8bd46b5be76471b8ff51598', 'request_id': 'req-19753f13-79e1-4fc1-bda3-6573eced911e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:34.235726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7deafb32a8bd46b5be76471b8ff51598', 'request_id': 'req-19753f13-79e1-4fc1-bda3-6573eced911e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:34.244785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7deafb32a8bd46b5be76471b8ff51598', 'request_id': 'req-19753f13-79e1-4fc1-bda3-6573eced911e'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:34.257920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] The token cache is being invalidate because project 7deafb32a8bd46b5be76471b8ff51598 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:34.258146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:34.258786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-19753f13-79e1-4fc1-bda3-6573eced911e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:34.260390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1181/2335] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:34 2022] DELETE /identity/v3/projects/7deafb32a8bd46b5be76471b8ff51598 => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:34.267893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725dd21-ed8c-4916-a43b-f15f89680d8d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.268071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725dd21-ed8c-4916-a43b-f15f89680d8d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.268320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1725dd21-ed8c-4916-a43b-f15f89680d8d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.294935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1725dd21-ed8c-4916-a43b-f15f89680d8d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:34.297289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1725dd21-ed8c-4916-a43b-f15f89680d8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:34.397894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1155/2336] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:34.399523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0411-3316-4498-abb6-cf0309fb3a6c None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.399809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0411-3316-4498-abb6-cf0309fb3a6c None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.400253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704f0411-3316-4498-abb6-cf0309fb3a6c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.420215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-704f0411-3316-4498-abb6-cf0309fb3a6c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:34.421467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-704f0411-3316-4498-abb6-cf0309fb3a6c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:34.434944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1182/2337] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:34.435919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725dd21-ed8c-4916-a43b-f15f89680d8d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:34.447261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1725dd21-ed8c-4916-a43b-f15f89680d8d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:34.452914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:34.453636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.453919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.454199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.454928 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:42:34.455268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:34.456890 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:34.475347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1156/2338] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:42:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:42:34.476555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f0411-3316-4498-abb6-cf0309fb3a6c None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:34.485986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704f0411-3316-4498-abb6-cf0309fb3a6c None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:34.492063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293c90-ece8-43fe-91d2-1a28d44fc7b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:34.492721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293c90-ece8-43fe-91d2-1a28d44fc7b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.493002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293c90-ece8-43fe-91d2-1a28d44fc7b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.493280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76293c90-ece8-43fe-91d2-1a28d44fc7b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.494062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76293c90-ece8-43fe-91d2-1a28d44fc7b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:34.495917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76293c90-ece8-43fe-91d2-1a28d44fc7b1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:34.527385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1183/2339] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:34 2022] POST /identity/v3/projects => generated 369 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:34.531789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:34.544026 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7021701d-b0b9-4ff0-94df-d668030539ad admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:34.574557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:34.616597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733d0ea-dac9-426a-bf1e-b359c0fb5505 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:34.617948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d0ea-dac9-426a-bf1e-b359c0fb5505 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.618226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d0ea-dac9-426a-bf1e-b359c0fb5505 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.618498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1733d0ea-dac9-426a-bf1e-b359c0fb5505 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.619200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733d0ea-dac9-426a-bf1e-b359c0fb5505 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:34.621113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1733d0ea-dac9-426a-bf1e-b359c0fb5505 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:34.649736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1157/2340] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:34 2022] POST /identity/v3/users => generated 285 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:42:34.659882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293c90-ece8-43fe-91d2-1a28d44fc7b1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:34.671630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76293c90-ece8-43fe-91d2-1a28d44fc7b1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:34.676877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7220c-c940-4a8e-861a-a6e3a2e10551 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:34.677639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7220c-c940-4a8e-861a-a6e3a2e10551 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.677915 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7220c-c940-4a8e-861a-a6e3a2e10551 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.678277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add7220c-c940-4a8e-861a-a6e3a2e10551 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.679007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7220c-c940-4a8e-861a-a6e3a2e10551 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:34.680747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add7220c-c940-4a8e-861a-a6e3a2e10551 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:34.692517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1184/2341] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:34.696961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733d0ea-dac9-426a-bf1e-b359c0fb5505 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:34.708152 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1733d0ea-dac9-426a-bf1e-b359c0fb5505 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:34.713792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c62707d-f228-472a-b1d2-04328c0b15b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:34.714591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62707d-f228-472a-b1d2-04328c0b15b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.714973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62707d-f228-472a-b1d2-04328c0b15b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.715347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c62707d-f228-472a-b1d2-04328c0b15b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.716164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62707d-f228-472a-b1d2-04328c0b15b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:34.717923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c62707d-f228-472a-b1d2-04328c0b15b2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:34.730636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1158/2342] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:42:34.734739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7220c-c940-4a8e-861a-a6e3a2e10551 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:34.745613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add7220c-c940-4a8e-861a-a6e3a2e10551 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:34.751395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80544822-ccc0-4b0f-a44c-6db8deefb23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:34.752268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80544822-ccc0-4b0f-a44c-6db8deefb23e admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.752549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80544822-ccc0-4b0f-a44c-6db8deefb23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.752837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80544822-ccc0-4b0f-a44c-6db8deefb23e admin admin] PATH_INFO: `/v3/projects/3c56a32a857d42178db39608a57fc77e/users/855f2abcdd48471b99511829ee79b69c/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.768378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80544822-ccc0-4b0f-a44c-6db8deefb23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c56a32a857d42178db39608a57fc77e, user_id=855f2abcdd48471b99511829ee79b69c, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:34.771613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80544822-ccc0-4b0f-a44c-6db8deefb23e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:34.787230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1185/2343] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:34 2022] PUT /identity/v3/projects/3c56a32a857d42178db39608a57fc77e/users/855f2abcdd48471b99511829ee79b69c/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:34.798552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168365-7cbd-4ea6-be73-ce5f1770d3b8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.798840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168365-7cbd-4ea6-be73-ce5f1770d3b8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.799117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d168365-7cbd-4ea6-be73-ce5f1770d3b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.827219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4d168365-7cbd-4ea6-be73-ce5f1770d3b8 None None] MFA Rules not processed for user `855f2abcdd48471b99511829ee79b69c`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:34.828435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4d168365-7cbd-4ea6-be73-ce5f1770d3b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:34.903128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1159/2344] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:34 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:34.907365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80544822-ccc0-4b0f-a44c-6db8deefb23e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:34.979312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:34.983445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80544822-ccc0-4b0f-a44c-6db8deefb23e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:34.989373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:34.990690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:34.991127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:34.991708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:34.992895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:34.995283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.022665 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1186/2345] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:34 2022] POST /identity/v3/projects => generated 367 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:35.026661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168365-7cbd-4ea6-be73-ce5f1770d3b8 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:35.039018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d168365-7cbd-4ea6-be73-ce5f1770d3b8 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:35.042680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:35.044399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:35.098565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1a099-cbd8-4552-9ba8-72c6b0a40696 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:35.100033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a099-cbd8-4552-9ba8-72c6b0a40696 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.100323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a099-cbd8-4552-9ba8-72c6b0a40696 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.100735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d1a099-cbd8-4552-9ba8-72c6b0a40696 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.101470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1a099-cbd8-4552-9ba8-72c6b0a40696 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:35.103532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d1a099-cbd8-4552-9ba8-72c6b0a40696 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.120254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd152b2e-5b25-40e1-877a-250cb00b0846 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:35.127431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1160/2346] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:35 2022] POST /identity/v3/users => generated 290 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:35.127594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:35.127594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.127594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.127594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.128412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1a099-cbd8-4552-9ba8-72c6b0a40696 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:35.129304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:35.137934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d1a099-cbd8-4552-9ba8-72c6b0a40696 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:35.142056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:35.142522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543fcd0-2873-4248-be93-fd4ef414f077 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:35.143163 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543fcd0-2873-4248-be93-fd4ef414f077 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.143448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543fcd0-2873-4248-be93-fd4ef414f077 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.143724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2543fcd0-2873-4248-be93-fd4ef414f077 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.144233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.144438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543fcd0-2873-4248-be93-fd4ef414f077 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:35.146082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2543fcd0-2873-4248-be93-fd4ef414f077 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.154984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1187/2347] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:42:35.156242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1161/2348] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:35.163161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:35.174959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb08a79e-ec38-4617-b6b9-d010189e9c33 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:35.181397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cf920-b453-4628-bcaf-e3da4d34d142 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:35.182293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cf920-b453-4628-bcaf-e3da4d34d142 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.182691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cf920-b453-4628-bcaf-e3da4d34d142 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.183062 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a54cf920-b453-4628-bcaf-e3da4d34d142 admin admin] PATH_INFO: `/v3/projects/c2fe39840a9745439cbc84ce276f70e1/users/60712f508de5425d9676fb3af07962de/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.200410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cf920-b453-4628-bcaf-e3da4d34d142 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fe39840a9745439cbc84ce276f70e1, user_id=60712f508de5425d9676fb3af07962de, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:35.203117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a54cf920-b453-4628-bcaf-e3da4d34d142 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.219852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1188/2349] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:35 2022] PUT /identity/v3/projects/c2fe39840a9745439cbc84ce276f70e1/users/60712f508de5425d9676fb3af07962de/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:35.223885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543fcd0-2873-4248-be93-fd4ef414f077 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:35.235368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2543fcd0-2873-4248-be93-fd4ef414f077 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:35.248976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:35.297721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fde2e5d7-fbdf-4df3-b1ab-37ab702b4e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:35.298382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e5d7-fbdf-4df3-b1ab-37ab702b4e44 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.298663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e5d7-fbdf-4df3-b1ab-37ab702b4e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.298938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fde2e5d7-fbdf-4df3-b1ab-37ab702b4e44 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.299655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2e5d7-fbdf-4df3-b1ab-37ab702b4e44 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:35.301272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fde2e5d7-fbdf-4df3-b1ab-37ab702b4e44 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.313529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1162/2350] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:35 2022] GET /identity/v3/roles => generated 1420 bytes in 90 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:35.319497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cf920-b453-4628-bcaf-e3da4d34d142 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:35.330271 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a54cf920-b453-4628-bcaf-e3da4d34d142 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:35.335499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:35.336668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.336956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.337352 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] PATH_INFO: `/v3/projects/c2fe39840a9745439cbc84ce276f70e1/users/60712f508de5425d9676fb3af07962de/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.339831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2fe39840a9745439cbc84ce276f70e1, user_id=60712f508de5425d9676fb3af07962de, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:35.342651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.353751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1189/2351] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:35 2022] PUT /identity/v3/projects/c2fe39840a9745439cbc84ce276f70e1/users/60712f508de5425d9676fb3af07962de/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:35.363978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a69c-0c5a-40e9-b6b0-e37fae1f08ab None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.364275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a69c-0c5a-40e9-b6b0-e37fae1f08ab None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.364561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded5a69c-0c5a-40e9-b6b0-e37fae1f08ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.398895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ded5a69c-0c5a-40e9-b6b0-e37fae1f08ab None None] MFA Rules not processed for user `60712f508de5425d9676fb3af07962de`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:35.400150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ded5a69c-0c5a-40e9-b6b0-e37fae1f08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:35.475393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1163/2352] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:35 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:35.487280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:35.489261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:35.553544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b6661c1-c458-4379-a3aa-07e535a7ca16 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:35.557028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eaa5a7-68fe-410e-9baa-29f781a88ea1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:35.557710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaa5a7-68fe-410e-9baa-29f781a88ea1 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.557984 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaa5a7-68fe-410e-9baa-29f781a88ea1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.558281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eaa5a7-68fe-410e-9baa-29f781a88ea1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.567372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaa5a7-68fe-410e-9baa-29f781a88ea1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:35.569458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eaa5a7-68fe-410e-9baa-29f781a88ea1 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.579001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1190/2353] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:35 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:35.622278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a69c-0c5a-40e9-b6b0-e37fae1f08ab None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:35.623865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ded5a69c-0c5a-40e9-b6b0-e37fae1f08ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:35.639219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded5a69c-0c5a-40e9-b6b0-e37fae1f08ab None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:35.643980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acba0d7-15c1-4776-b721-068862a60a36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:35.644704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acba0d7-15c1-4776-b721-068862a60a36 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:35.645120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acba0d7-15c1-4776-b721-068862a60a36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:35.645624 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9acba0d7-15c1-4776-b721-068862a60a36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:35.714096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acba0d7-15c1-4776-b721-068862a60a36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:35.715522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9acba0d7-15c1-4776-b721-068862a60a36 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:35.725252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1164/2354] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:35 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:39.092037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51f751-31ca-4aed-8102-065c4acc8273 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:39.092546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51f751-31ca-4aed-8102-065c4acc8273 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:39.092811 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c51f751-31ca-4aed-8102-065c4acc8273 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:39.115776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8c51f751-31ca-4aed-8102-065c4acc8273 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:39.117506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8c51f751-31ca-4aed-8102-065c4acc8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:39.139500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acba0d7-15c1-4776-b721-068862a60a36 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:39.171916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:39.187126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:39.210727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1191/2355] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:42:39 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:39.217798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9acba0d7-15c1-4776-b721-068862a60a36 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:39.218002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51f751-31ca-4aed-8102-065c4acc8273 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:39.219380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8c51f751-31ca-4aed-8102-065c4acc8273 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:39.222722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:39.223666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:39.224203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:39.224411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] PATH_INFO: `/v3/users/855f2abcdd48471b99511829ee79b69c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:39.225723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=855f2abcdd48471b99511829ee79b69c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:39.227785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:39.285156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '855f2abcdd48471b99511829ee79b69c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:39.299866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '855f2abcdd48471b99511829ee79b69c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:39.304605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c51f751-31ca-4aed-8102-065c4acc8273 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:39.308240 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '855f2abcdd48471b99511829ee79b69c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:39.310996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:39.311741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:39.312086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:39.312423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:39.317252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '855f2abcdd48471b99511829ee79b69c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:39.318615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-eeddf535-da1e-4d05-ba6b-cc76272a52ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '855f2abcdd48471b99511829ee79b69c'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:39.324151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:39.325937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:39.326083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1165/2356] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:39 2022] DELETE /identity/v3/users/855f2abcdd48471b99511829ee79b69c => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:39.330662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34094-0f82-4c21-9117-ced80b1d3de6 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:39.330954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34094-0f82-4c21-9117-ced80b1d3de6 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:39.331232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7c34094-0f82-4c21-9117-ced80b1d3de6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:39.339301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1192/2357] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:42:39 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 12 08:42:39.352324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b7c34094-0f82-4c21-9117-ced80b1d3de6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:39.353721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b7c34094-0f82-4c21-9117-ced80b1d3de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:39.441465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1166/2358] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:42:39.452655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:39.454701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:39.551110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86cb6ddd-a41e-4d21-9f46-db84a6cf5d3d service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:39.619644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:39.620241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:39.620857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:39.620979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:39.633050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:39.634663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:39.666299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1193/2359] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:39.964094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34094-0f82-4c21-9117-ced80b1d3de6 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:39.966146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b7c34094-0f82-4c21-9117-ced80b1d3de6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:40.131471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:40.184594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7c34094-0f82-4c21-9117-ced80b1d3de6 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:40.195791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:40.199562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:40.199924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:40.202530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:40.209663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:40.250938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:40.252580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:40.278006 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1167/2360] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:40.315945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:40.318445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:40.347836 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c00eb82-9f87-4689-946b-29bff7cfe4cb service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:40.355971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:40.357458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:40.357883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:40.358260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] PATH_INFO: `/v3/projects/3c56a32a857d42178db39608a57fc77e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:40.359755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c56a32a857d42178db39608a57fc77e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:40.362169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:40.432071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:40.450259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c56a32a857d42178db39608a57fc77e', 'request_id': 'req-e72182a5-e71f-4043-ab50-2e2a3c98ed54'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.456432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c56a32a857d42178db39608a57fc77e', 'request_id': 'req-e72182a5-e71f-4043-ab50-2e2a3c98ed54'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.487475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c56a32a857d42178db39608a57fc77e', 'request_id': 'req-e72182a5-e71f-4043-ab50-2e2a3c98ed54'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.507446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] The token cache is being invalidate because project 3c56a32a857d42178db39608a57fc77e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:40.507772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.508566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.510190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1194/2361] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:40 2022] DELETE /identity/v3/projects/3c56a32a857d42178db39608a57fc77e => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:40.514524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:40.529331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba98e879-7663-41df-bf1c-3cef3cd6eaa2 service nova] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:40.631506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:40.634302 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:40.635258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:40.635914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] PATH_INFO: `/v3/users/60712f508de5425d9676fb3af07962de` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:40.648290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60712f508de5425d9676fb3af07962de)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:40.650500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:40.731594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60712f508de5425d9676fb3af07962de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.746540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60712f508de5425d9676fb3af07962de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.754707 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60712f508de5425d9676fb3af07962de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.769773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60712f508de5425d9676fb3af07962de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.774219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-1f0f205c-fca6-47c8-af09-e94fcd8003a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60712f508de5425d9676fb3af07962de'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:40.785471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1168/2362] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:40 2022] DELETE /identity/v3/users/60712f508de5425d9676fb3af07962de => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:41.193982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:41.196482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:41.226108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72182a5-e71f-4043-ab50-2e2a3c98ed54 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:41.325310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:41.326912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.327348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.327807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] PATH_INFO: `/v3/projects/c2fe39840a9745439cbc84ce276f70e1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.329725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2fe39840a9745439cbc84ce276f70e1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:41.332501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:41.417357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2fe39840a9745439cbc84ce276f70e1', 'request_id': 'req-6be0b091-b2ee-4343-ac30-138b73e685e4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:41.429828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2fe39840a9745439cbc84ce276f70e1', 'request_id': 'req-6be0b091-b2ee-4343-ac30-138b73e685e4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:41.450635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2fe39840a9745439cbc84ce276f70e1', 'request_id': 'req-6be0b091-b2ee-4343-ac30-138b73e685e4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:41.472831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] The token cache is being invalidate because project c2fe39840a9745439cbc84ce276f70e1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:41.473116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:41.474953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6be0b091-b2ee-4343-ac30-138b73e685e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:41.477708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1195/2363] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:41 2022] DELETE /identity/v3/projects/c2fe39840a9745439cbc84ce276f70e1 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:41.482214 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ead1a-60d7-4588-adad-815feedd6f2c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.483649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ead1a-60d7-4588-adad-815feedd6f2c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.484090 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b04ead1a-60d7-4588-adad-815feedd6f2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.515205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b04ead1a-60d7-4588-adad-815feedd6f2c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:41.516695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b04ead1a-60d7-4588-adad-815feedd6f2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:41.605525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:41.617646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1169/2364] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:41.621929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7480da5-80f7-496f-8af3-11a5e9e0fc3f None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.622413 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7480da5-80f7-496f-8af3-11a5e9e0fc3f None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.622859 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7480da5-80f7-496f-8af3-11a5e9e0fc3f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.648198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d7480da5-80f7-496f-8af3-11a5e9e0fc3f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:41.649597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d7480da5-80f7-496f-8af3-11a5e9e0fc3f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:41.662213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1196/2365] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:41.667326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ead1a-60d7-4588-adad-815feedd6f2c None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:41.679573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b04ead1a-60d7-4588-adad-815feedd6f2c None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:41.684976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:41.685668 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.685950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.686224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.686988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:42:41.687292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:41.688935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:41.702955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1170/2366] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:42:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:42:41.709461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7480da5-80f7-496f-8af3-11a5e9e0fc3f None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:41.720341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7480da5-80f7-496f-8af3-11a5e9e0fc3f None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:41.725789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c368eb-ad68-4b9f-8271-f42aee853356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:41.726450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c368eb-ad68-4b9f-8271-f42aee853356 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.726733 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c368eb-ad68-4b9f-8271-f42aee853356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.727065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6c368eb-ad68-4b9f-8271-f42aee853356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.728369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c368eb-ad68-4b9f-8271-f42aee853356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:41.730340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6c368eb-ad68-4b9f-8271-f42aee853356 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:41.760787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1197/2367] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:41 2022] POST /identity/v3/projects => generated 385 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:41.764934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:41.776363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3380bd-45f8-429c-b663-baaba676567e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:41.840110 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104da3e3-1418-43a9-9b9d-3e9118a58e63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:41.840792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da3e3-1418-43a9-9b9d-3e9118a58e63 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.841076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da3e3-1418-43a9-9b9d-3e9118a58e63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.841360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104da3e3-1418-43a9-9b9d-3e9118a58e63 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.842099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104da3e3-1418-43a9-9b9d-3e9118a58e63 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:41.844039 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104da3e3-1418-43a9-9b9d-3e9118a58e63 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:41.864975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1171/2368] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:41 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:41.869262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c368eb-ad68-4b9f-8271-f42aee853356 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:41.881361 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6c368eb-ad68-4b9f-8271-f42aee853356 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:41.886446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca4d8-6870-4b7b-ac72-bc7ee98b4c37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:41.887118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca4d8-6870-4b7b-ac72-bc7ee98b4c37 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.887399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca4d8-6870-4b7b-ac72-bc7ee98b4c37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.887671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-206ca4d8-6870-4b7b-ac72-bc7ee98b4c37 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.888404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ca4d8-6870-4b7b-ac72-bc7ee98b4c37 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:41.890050 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-206ca4d8-6870-4b7b-ac72-bc7ee98b4c37 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:41.902626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1198/2369] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:42:41.906858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104da3e3-1418-43a9-9b9d-3e9118a58e63 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:41.917701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104da3e3-1418-43a9-9b9d-3e9118a58e63 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:41.922465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3dbd48-335b-4ed2-9fde-32228aea9407 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:41.923117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dbd48-335b-4ed2-9fde-32228aea9407 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.923395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dbd48-335b-4ed2-9fde-32228aea9407 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.923667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3dbd48-335b-4ed2-9fde-32228aea9407 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.924411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dbd48-335b-4ed2-9fde-32228aea9407 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:41.926033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3dbd48-335b-4ed2-9fde-32228aea9407 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:41.940656 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1172/2370] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:41 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:41.942013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca4d8-6870-4b7b-ac72-bc7ee98b4c37 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:41.949785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=13,keystone:SELECT=84,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:41.953821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-206ca4d8-6870-4b7b-ac72-bc7ee98b4c37 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:41.962144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13c68-9b00-439c-8a75-4e5e49395663 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:41.963310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13c68-9b00-439c-8a75-4e5e49395663 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:41.963939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13c68-9b00-439c-8a75-4e5e49395663 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:41.964597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e13c68-9b00-439c-8a75-4e5e49395663 admin admin] PATH_INFO: `/v3/projects/a4e003122f974d40bc582f5fd22d10fd/users/1cd0093a1fb649f6899e2279602d7d67/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:41.981575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13c68-9b00-439c-8a75-4e5e49395663 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a4e003122f974d40bc582f5fd22d10fd, user_id=1cd0093a1fb649f6899e2279602d7d67, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:41.984242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e13c68-9b00-439c-8a75-4e5e49395663 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:41.998322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1199/2371] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:41 2022] PUT /identity/v3/projects/a4e003122f974d40bc582f5fd22d10fd/users/1cd0093a1fb649f6899e2279602d7d67/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:42.011848 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b088c2-5e43-4117-a784-b24106c9a538 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.012136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b088c2-5e43-4117-a784-b24106c9a538 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.012413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b088c2-5e43-4117-a784-b24106c9a538 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.044774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-43b088c2-5e43-4117-a784-b24106c9a538 None None] MFA Rules not processed for user `1cd0093a1fb649f6899e2279602d7d67`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:42.045962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-43b088c2-5e43-4117-a784-b24106c9a538 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:42.127165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1173/2372] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:42.132069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13c68-9b00-439c-8a75-4e5e49395663 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.202349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e13c68-9b00-439c-8a75-4e5e49395663 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.209033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4180b-e8e3-4125-850f-7cf1095edf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.210076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4180b-e8e3-4125-850f-7cf1095edf3f admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.210657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4180b-e8e3-4125-850f-7cf1095edf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.211223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa4180b-e8e3-4125-850f-7cf1095edf3f admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.212380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4180b-e8e3-4125-850f-7cf1095edf3f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.214809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa4180b-e8e3-4125-850f-7cf1095edf3f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.247364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1200/2373] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:42 2022] POST /identity/v3/projects => generated 385 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:42.251785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b088c2-5e43-4117-a784-b24106c9a538 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.263297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b088c2-5e43-4117-a784-b24106c9a538 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.334036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:42.343986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73456b58-8e54-493c-9705-a431bb6fc8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.344770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456b58-8e54-493c-9705-a431bb6fc8f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.345150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456b58-8e54-493c-9705-a431bb6fc8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.345543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73456b58-8e54-493c-9705-a431bb6fc8f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.346341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73456b58-8e54-493c-9705-a431bb6fc8f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.348338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73456b58-8e54-493c-9705-a431bb6fc8f1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.377457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1174/2374] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:42 2022] POST /identity/v3/users => generated 293 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:42.379277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4180b-e8e3-4125-850f-7cf1095edf3f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.390677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa4180b-e8e3-4125-850f-7cf1095edf3f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.395818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c6811-f215-43df-bf26-e7ecc7f8bf73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.396660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6811-f215-43df-bf26-e7ecc7f8bf73 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.397005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6811-f215-43df-bf26-e7ecc7f8bf73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.397384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355c6811-f215-43df-bf26-e7ecc7f8bf73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.398223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c6811-f215-43df-bf26-e7ecc7f8bf73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.399911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355c6811-f215-43df-bf26-e7ecc7f8bf73 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.421265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1201/2375] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:42:42.422514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73456b58-8e54-493c-9705-a431bb6fc8f1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.433655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73456b58-8e54-493c-9705-a431bb6fc8f1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.438503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-735cfb84-e30c-4fec-bc5d-62180306d4bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.439162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cfb84-e30c-4fec-bc5d-62180306d4bf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.439445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cfb84-e30c-4fec-bc5d-62180306d4bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.439721 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-735cfb84-e30c-4fec-bc5d-62180306d4bf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.440446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cfb84-e30c-4fec-bc5d-62180306d4bf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.442405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-735cfb84-e30c-4fec-bc5d-62180306d4bf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.454684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1175/2376] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:42.459394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c6811-f215-43df-bf26-e7ecc7f8bf73 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.470651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355c6811-f215-43df-bf26-e7ecc7f8bf73 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.476183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c623-4e4d-4ec2-92db-1c740efd94fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.477230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c623-4e4d-4ec2-92db-1c740efd94fa admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.477608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c623-4e4d-4ec2-92db-1c740efd94fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.477951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9971c623-4e4d-4ec2-92db-1c740efd94fa admin admin] PATH_INFO: `/v3/projects/69be233a46174c8187f037f74a796271/users/70a988763aae49eca9c2365057a7aeca/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.496667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c623-4e4d-4ec2-92db-1c740efd94fa admin admin] RBAC: Authorizing `identity:create_grant(project_id=69be233a46174c8187f037f74a796271, user_id=70a988763aae49eca9c2365057a7aeca, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.499388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9971c623-4e4d-4ec2-92db-1c740efd94fa admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.515805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1202/2377] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:42 2022] PUT /identity/v3/projects/69be233a46174c8187f037f74a796271/users/70a988763aae49eca9c2365057a7aeca/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:42:42.526767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6815cc-1384-4539-b5ee-e671a61c886f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.527592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6815cc-1384-4539-b5ee-e671a61c886f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.527690 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6815cc-1384-4539-b5ee-e671a61c886f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.555972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8b6815cc-1384-4539-b5ee-e671a61c886f None None] MFA Rules not processed for user `70a988763aae49eca9c2365057a7aeca`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:42.557237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8b6815cc-1384-4539-b5ee-e671a61c886f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:42.639014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1176/2378] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:42.646957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c623-4e4d-4ec2-92db-1c740efd94fa admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.726311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9971c623-4e4d-4ec2-92db-1c740efd94fa admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.737943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9a4e-0fac-45cf-89a3-71307c50427d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.739119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9a4e-0fac-45cf-89a3-71307c50427d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.740223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9a4e-0fac-45cf-89a3-71307c50427d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.740704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7a9a4e-0fac-45cf-89a3-71307c50427d admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.741213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a9a4e-0fac-45cf-89a3-71307c50427d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.743357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7a9a4e-0fac-45cf-89a3-71307c50427d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.784952 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1203/2379] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:42 2022] POST /identity/v3/projects => generated 387 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:42.789158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6815cc-1384-4539-b5ee-e671a61c886f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.805552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6815cc-1384-4539-b5ee-e671a61c886f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.867648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce7642-4f63-44c7-8c37-4149c2b29447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.868224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce7642-4f63-44c7-8c37-4149c2b29447 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.868504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce7642-4f63-44c7-8c37-4149c2b29447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.868779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75ce7642-4f63-44c7-8c37-4149c2b29447 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.869502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce7642-4f63-44c7-8c37-4149c2b29447 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.871574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75ce7642-4f63-44c7-8c37-4149c2b29447 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.899878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1177/2380] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:42 2022] POST /identity/v3/users => generated 300 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:42.903294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9a4e-0fac-45cf-89a3-71307c50427d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.916085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7a9a4e-0fac-45cf-89a3-71307c50427d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.920770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20ae19-da0f-41c6-85a6-e4a521d22959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.921465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ae19-da0f-41c6-85a6-e4a521d22959 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.921748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ae19-da0f-41c6-85a6-e4a521d22959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.922025 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c20ae19-da0f-41c6-85a6-e4a521d22959 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.922759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20ae19-da0f-41c6-85a6-e4a521d22959 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.924381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c20ae19-da0f-41c6-85a6-e4a521d22959 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.940467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1204/2381] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:42.943212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce7642-4f63-44c7-8c37-4149c2b29447 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:42.953833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75ce7642-4f63-44c7-8c37-4149c2b29447 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:42.959760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ab2d2-4f48-499a-b729-f75543f8a89b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:42.960858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab2d2-4f48-499a-b729-f75543f8a89b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:42.961139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab2d2-4f48-499a-b729-f75543f8a89b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:42.961433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69ab2d2-4f48-499a-b729-f75543f8a89b admin admin] PATH_INFO: `/v3/projects/2148989406944989ba1684da729b43ab/users/08cba5202bb5404b9368f3eb5014a4e1/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:42.977989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ab2d2-4f48-499a-b729-f75543f8a89b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2148989406944989ba1684da729b43ab, user_id=08cba5202bb5404b9368f3eb5014a4e1, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:42.980664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c69ab2d2-4f48-499a-b729-f75543f8a89b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:42.996264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1178/2382] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:42 2022] PUT /identity/v3/projects/2148989406944989ba1684da729b43ab/users/08cba5202bb5404b9368f3eb5014a4e1/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:43.000501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20ae19-da0f-41c6-85a6-e4a521d22959 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:43.010207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:43.014931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c20ae19-da0f-41c6-85a6-e4a521d22959 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:43.075771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3aec59c-830f-461d-8ae6-00617ed417c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:43.076587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec59c-830f-461d-8ae6-00617ed417c8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:43.076863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec59c-830f-461d-8ae6-00617ed417c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:43.077135 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3aec59c-830f-461d-8ae6-00617ed417c8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:43.077893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aec59c-830f-461d-8ae6-00617ed417c8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:43.079490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3aec59c-830f-461d-8ae6-00617ed417c8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:43.092104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1205/2383] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:42 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:43.095889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ab2d2-4f48-499a-b729-f75543f8a89b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:43.107015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69ab2d2-4f48-499a-b729-f75543f8a89b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:43.111588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:43.112462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:43.112743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:43.113015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] PATH_INFO: `/v3/projects/2148989406944989ba1684da729b43ab/users/08cba5202bb5404b9368f3eb5014a4e1/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:43.115674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2148989406944989ba1684da729b43ab, user_id=08cba5202bb5404b9368f3eb5014a4e1, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:43.118404 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:43.129088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1179/2384] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:43 2022] PUT /identity/v3/projects/2148989406944989ba1684da729b43ab/users/08cba5202bb5404b9368f3eb5014a4e1/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:43.140933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992afbe-bf04-4db1-996f-93a275431929 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:43.141216 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992afbe-bf04-4db1-996f-93a275431929 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:43.141588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2992afbe-bf04-4db1-996f-93a275431929 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:43.174835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2992afbe-bf04-4db1-996f-93a275431929 None None] MFA Rules not processed for user `08cba5202bb5404b9368f3eb5014a4e1`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:43.177006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2992afbe-bf04-4db1-996f-93a275431929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:43.254480 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1206/2385] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:43 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:43.266306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:43.268028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:43.288512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:43.338015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-530a6049-3fa8-4519-826e-558b0ddc97b0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:43.341554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cca3a-6e1a-4ce5-8ee8-e6b5599984fc service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:43.342210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cca3a-6e1a-4ce5-8ee8-e6b5599984fc service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:43.342496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cca3a-6e1a-4ce5-8ee8-e6b5599984fc service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:43.342778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047cca3a-6e1a-4ce5-8ee8-e6b5599984fc service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:43.366702 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cca3a-6e1a-4ce5-8ee8-e6b5599984fc service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:43.368577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-047cca3a-6e1a-4ce5-8ee8-e6b5599984fc service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:43.378910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1180/2386] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:43 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:44.035341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992afbe-bf04-4db1-996f-93a275431929 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:44.037065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2992afbe-bf04-4db1-996f-93a275431929 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:44.050418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2992afbe-bf04-4db1-996f-93a275431929 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:44.054898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859045d-782f-4ae2-b9b5-6b163bdbd87b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:44.055737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859045d-782f-4ae2-b9b5-6b163bdbd87b service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:44.056174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859045d-782f-4ae2-b9b5-6b163bdbd87b service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:44.056569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a859045d-782f-4ae2-b9b5-6b163bdbd87b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:44.123201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859045d-782f-4ae2-b9b5-6b163bdbd87b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:44.124768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a859045d-782f-4ae2-b9b5-6b163bdbd87b service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:44.135557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1207/2387] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:44 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:48.258194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cca3a-6e1a-4ce5-8ee8-e6b5599984fc service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:48.266807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-047cca3a-6e1a-4ce5-8ee8-e6b5599984fc service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:48.270982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c999b346-3793-4e1c-8963-fdfa52b25608 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:48.271795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b346-3793-4e1c-8963-fdfa52b25608 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:48.272082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b346-3793-4e1c-8963-fdfa52b25608 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:48.272363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c999b346-3793-4e1c-8963-fdfa52b25608 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:48.329295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999b346-3793-4e1c-8963-fdfa52b25608 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:48.330753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c999b346-3793-4e1c-8963-fdfa52b25608 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:48.340181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1181/2388] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:48 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:50.466633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859045d-782f-4ae2-b9b5-6b163bdbd87b service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:50.496348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:50.535874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a859045d-782f-4ae2-b9b5-6b163bdbd87b service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:50.541175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:50.542182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:50.542500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:50.542834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] PATH_INFO: `/v3/users/1cd0093a1fb649f6899e2279602d7d67` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:50.544072 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1cd0093a1fb649f6899e2279602d7d67)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:50.546085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:50.593323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1cd0093a1fb649f6899e2279602d7d67'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:50.601037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1cd0093a1fb649f6899e2279602d7d67'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:50.609784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1cd0093a1fb649f6899e2279602d7d67'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:50.623528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1cd0093a1fb649f6899e2279602d7d67'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:50.624306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1cd0093a1fb649f6899e2279602d7d67'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:50.631679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1208/2389] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:50 2022] DELETE /identity/v3/users/1cd0093a1fb649f6899e2279602d7d67 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:50.636338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54d3d-09e0-47f9-b879-ff913541fa57 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:50.636855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54d3d-09e0-47f9-b879-ff913541fa57 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:50.636973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf54d3d-09e0-47f9-b879-ff913541fa57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:50.654588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ebf54d3d-09e0-47f9-b879-ff913541fa57 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:50.655810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ebf54d3d-09e0-47f9-b879-ff913541fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:50.722742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1182/2390] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:50.733763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:50.735867 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:50.800731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3251af0e-a27c-487c-aaa8-8430c0cece11 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:50.805443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070b3a-4db2-4383-9548-a105678bc3b7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:50.806080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070b3a-4db2-4383-9548-a105678bc3b7 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:50.806360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070b3a-4db2-4383-9548-a105678bc3b7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:50.806634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33070b3a-4db2-4383-9548-a105678bc3b7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:50.817292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33070b3a-4db2-4383-9548-a105678bc3b7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:50.818945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33070b3a-4db2-4383-9548-a105678bc3b7 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:50.829823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1209/2391] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:51.118344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54d3d-09e0-47f9-b879-ff913541fa57 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:51.120336 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ebf54d3d-09e0-47f9-b879-ff913541fa57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:51.140044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf54d3d-09e0-47f9-b879-ff913541fa57 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:51.144878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:51.146404 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:51.146574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:51.146934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] PATH_INFO: `/v3/projects/a4e003122f974d40bc582f5fd22d10fd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:51.148137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] RBAC: Authorizing `identity:delete_project(project_id=a4e003122f974d40bc582f5fd22d10fd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:51.154352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:51.201067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a4e003122f974d40bc582f5fd22d10fd', 'request_id': 'req-8a592e3e-ecda-445f-bbed-d0974fcd631a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.202907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:51.207138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a4e003122f974d40bc582f5fd22d10fd', 'request_id': 'req-8a592e3e-ecda-445f-bbed-d0974fcd631a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.214172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a4e003122f974d40bc582f5fd22d10fd', 'request_id': 'req-8a592e3e-ecda-445f-bbed-d0974fcd631a'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.224906 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] The token cache is being invalidate because project a4e003122f974d40bc582f5fd22d10fd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:51.225189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.225838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.227385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1183/2392] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:51 2022] DELETE /identity/v3/projects/a4e003122f974d40bc582f5fd22d10fd => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:51.231477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070b3a-4db2-4383-9548-a105678bc3b7 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:51.243128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33070b3a-4db2-4383-9548-a105678bc3b7 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:51.286942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:51.301200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:51.302810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:51.303090 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:51.303363 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] PATH_INFO: `/v3/users/70a988763aae49eca9c2365057a7aeca` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:51.304544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70a988763aae49eca9c2365057a7aeca)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:51.306510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:51.350823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70a988763aae49eca9c2365057a7aeca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.357475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70a988763aae49eca9c2365057a7aeca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.365519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70a988763aae49eca9c2365057a7aeca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.377201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70a988763aae49eca9c2365057a7aeca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.377839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70a988763aae49eca9c2365057a7aeca'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.384411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1210/2393] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:51 2022] DELETE /identity/v3/users/70a988763aae49eca9c2365057a7aeca => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:51.668339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:51.669832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:51.685088 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a592e3e-ecda-445f-bbed-d0974fcd631a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:51.747279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:51.748094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:51.748368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:51.748634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] PATH_INFO: `/v3/projects/69be233a46174c8187f037f74a796271` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:51.749943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=69be233a46174c8187f037f74a796271)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:51.751919 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:51.799986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69be233a46174c8187f037f74a796271', 'request_id': 'req-f3efa371-5cca-44f6-8026-f5acd92e9ee5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.805972 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69be233a46174c8187f037f74a796271', 'request_id': 'req-f3efa371-5cca-44f6-8026-f5acd92e9ee5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.814290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69be233a46174c8187f037f74a796271', 'request_id': 'req-f3efa371-5cca-44f6-8026-f5acd92e9ee5'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.826031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] The token cache is being invalidate because project 69be233a46174c8187f037f74a796271 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:51.826318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.827552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:51.829128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1184/2394] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:51 2022] DELETE /identity/v3/projects/69be233a46174c8187f037f74a796271 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:51.833625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:51.835178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:51.847860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defb3aaf-2a81-4e2d-a57c-abc51902f3f0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:51.948310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:51.949196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:51.949499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:51.949773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] PATH_INFO: `/v3/users/08cba5202bb5404b9368f3eb5014a4e1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:51.951166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] RBAC: Authorizing `identity:delete_user(user_id=08cba5202bb5404b9368f3eb5014a4e1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:51.953456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:52.013189 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '08cba5202bb5404b9368f3eb5014a4e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.022222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '08cba5202bb5404b9368f3eb5014a4e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.030530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '08cba5202bb5404b9368f3eb5014a4e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.036108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:52.045819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '08cba5202bb5404b9368f3eb5014a4e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.047175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0b78c74a-a9ce-43a6-8dbc-4b170a26d134 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '08cba5202bb5404b9368f3eb5014a4e1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.054824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1211/2395] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:51 2022] DELETE /identity/v3/users/08cba5202bb5404b9368f3eb5014a4e1 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:52.446456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:52.447893 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:52.460788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3efa371-5cca-44f6-8026-f5acd92e9ee5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:52.521993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:52.522777 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.523075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.523349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] PATH_INFO: `/v3/projects/2148989406944989ba1684da729b43ab` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:52.524561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2148989406944989ba1684da729b43ab)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:52.526508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:52.537837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:52.574300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2148989406944989ba1684da729b43ab', 'request_id': 'req-5512496d-5d43-4a00-84f0-0fd56f5622c8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.579648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2148989406944989ba1684da729b43ab', 'request_id': 'req-5512496d-5d43-4a00-84f0-0fd56f5622c8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.587111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2148989406944989ba1684da729b43ab', 'request_id': 'req-5512496d-5d43-4a00-84f0-0fd56f5622c8'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.598141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] The token cache is being invalidate because project 2148989406944989ba1684da729b43ab was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:52.598673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.599293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-5512496d-5d43-4a00-84f0-0fd56f5622c8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:52.600933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1185/2396] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:52 2022] DELETE /identity/v3/projects/2148989406944989ba1684da729b43ab => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:52.606871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec570bd-2c9c-4082-9993-b13282651ea2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.607161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec570bd-2c9c-4082-9993-b13282651ea2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.607442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec570bd-2c9c-4082-9993-b13282651ea2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:52.627687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-dec570bd-2c9c-4082-9993-b13282651ea2 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:52.628897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dec570bd-2c9c-4082-9993-b13282651ea2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:52.688339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1212/2397] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:52.697368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080a6ab-f4d9-4243-824f-712fe54129cf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.697867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080a6ab-f4d9-4243-824f-712fe54129cf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.698164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1080a6ab-f4d9-4243-824f-712fe54129cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:52.716611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1080a6ab-f4d9-4243-824f-712fe54129cf None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:52.717850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1080a6ab-f4d9-4243-824f-712fe54129cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:52.726230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1186/2398] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:42:52.730850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec570bd-2c9c-4082-9993-b13282651ea2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:52.741518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec570bd-2c9c-4082-9993-b13282651ea2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:52.746406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:52.747049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.747329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.747596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:52.748312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:42:52.748613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:52.750245 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:52.762613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1213/2399] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:42:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:42:52.766834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080a6ab-f4d9-4243-824f-712fe54129cf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:52.776274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1080a6ab-f4d9-4243-824f-712fe54129cf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:52.781195 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f8fb-a1f8-4289-a610-b9817d07e44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:52.781868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f8fb-a1f8-4289-a610-b9817d07e44b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.782153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f8fb-a1f8-4289-a610-b9817d07e44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.782433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e705f8fb-a1f8-4289-a610-b9817d07e44b admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:52.783121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f8fb-a1f8-4289-a610-b9817d07e44b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:52.785020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e705f8fb-a1f8-4289-a610-b9817d07e44b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:52.809982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1187/2400] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:52 2022] POST /identity/v3/projects => generated 391 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:42:52.819261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:52.830010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f585e3-fc87-4a56-84b6-d890c6218950 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:52.886960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25dfed-86b2-42dd-a1b1-8c44a8e66aa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:52.887625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25dfed-86b2-42dd-a1b1-8c44a8e66aa0 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.887904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25dfed-86b2-42dd-a1b1-8c44a8e66aa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.888178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc25dfed-86b2-42dd-a1b1-8c44a8e66aa0 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:52.888860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25dfed-86b2-42dd-a1b1-8c44a8e66aa0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:52.890798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc25dfed-86b2-42dd-a1b1-8c44a8e66aa0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:52.911513 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1214/2401] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:52 2022] POST /identity/v3/users => generated 296 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:52.915592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f8fb-a1f8-4289-a610-b9817d07e44b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:52.926371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e705f8fb-a1f8-4289-a610-b9817d07e44b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:52.930927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b95316-1dad-4720-9985-db9231f51e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:52.931573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b95316-1dad-4720-9985-db9231f51e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.931852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b95316-1dad-4720-9985-db9231f51e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.932124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40b95316-1dad-4720-9985-db9231f51e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:52.932840 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b95316-1dad-4720-9985-db9231f51e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:52.934469 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40b95316-1dad-4720-9985-db9231f51e22 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:52.945264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1188/2402] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:52.949492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25dfed-86b2-42dd-a1b1-8c44a8e66aa0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:52.959920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc25dfed-86b2-42dd-a1b1-8c44a8e66aa0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:52.964445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70ebccb-a951-4b9b-9307-7ad58637b5da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:52.965093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebccb-a951-4b9b-9307-7ad58637b5da admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.965374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebccb-a951-4b9b-9307-7ad58637b5da admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.965678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70ebccb-a951-4b9b-9307-7ad58637b5da admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:52.966400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ebccb-a951-4b9b-9307-7ad58637b5da admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:52.967978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e70ebccb-a951-4b9b-9307-7ad58637b5da admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:52.977935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1215/2403] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:52 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:52.981989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b95316-1dad-4720-9985-db9231f51e22 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:52.992149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40b95316-1dad-4720-9985-db9231f51e22 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:52.996722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7677-01d6-4d6e-a157-51cdc90d1f0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:52.997640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7677-01d6-4d6e-a157-51cdc90d1f0b admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:52.997923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7677-01d6-4d6e-a157-51cdc90d1f0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:52.998233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078f7677-01d6-4d6e-a157-51cdc90d1f0b admin admin] PATH_INFO: `/v3/projects/cd5e3fb2f77740759c3d8b5ce316ca93/users/19ca43a4f9164dbb8478a3767f1410c6/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.012976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7677-01d6-4d6e-a157-51cdc90d1f0b admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd5e3fb2f77740759c3d8b5ce316ca93, user_id=19ca43a4f9164dbb8478a3767f1410c6, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:53.015756 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-078f7677-01d6-4d6e-a157-51cdc90d1f0b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:53.030564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1189/2404] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:52 2022] PUT /identity/v3/projects/cd5e3fb2f77740759c3d8b5ce316ca93/users/19ca43a4f9164dbb8478a3767f1410c6/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:53.042754 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a39a-e73a-47c5-8f28-b396511aa677 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.043048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a39a-e73a-47c5-8f28-b396511aa677 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.043328 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a2a39a-e73a-47c5-8f28-b396511aa677 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.075625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-47a2a39a-e73a-47c5-8f28-b396511aa677 None None] MFA Rules not processed for user `19ca43a4f9164dbb8478a3767f1410c6`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:53.076902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-47a2a39a-e73a-47c5-8f28-b396511aa677 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:53.122353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=2,keystone:SELECT=95,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:53.149130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1216/2405] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:53 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:53.153641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7677-01d6-4d6e-a157-51cdc90d1f0b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:53.219521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078f7677-01d6-4d6e-a157-51cdc90d1f0b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:53.224363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8392b8-830f-446e-a39b-94b37fa9a2b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:53.225089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8392b8-830f-446e-a39b-94b37fa9a2b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.225370 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8392b8-830f-446e-a39b-94b37fa9a2b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.225673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8392b8-830f-446e-a39b-94b37fa9a2b5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.226373 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8392b8-830f-446e-a39b-94b37fa9a2b5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:53.228263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8392b8-830f-446e-a39b-94b37fa9a2b5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:53.253387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1190/2406] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:53 2022] POST /identity/v3/projects => generated 393 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:53.257808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2a39a-e73a-47c5-8f28-b396511aa677 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:53.268268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a2a39a-e73a-47c5-8f28-b396511aa677 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:53.325198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e354f8-44c8-4e40-9bbb-9228acc435e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:53.325900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e354f8-44c8-4e40-9bbb-9228acc435e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.326182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e354f8-44c8-4e40-9bbb-9228acc435e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.326454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1e354f8-44c8-4e40-9bbb-9228acc435e7 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.327153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e354f8-44c8-4e40-9bbb-9228acc435e7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:53.329084 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1e354f8-44c8-4e40-9bbb-9228acc435e7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:53.352078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1217/2407] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:53 2022] POST /identity/v3/users => generated 303 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:53.353313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8392b8-830f-446e-a39b-94b37fa9a2b5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:53.363557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8392b8-830f-446e-a39b-94b37fa9a2b5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:53.369847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501ee4b-2d96-4954-b71d-4c54a33fb656 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:53.370667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501ee4b-2d96-4954-b71d-4c54a33fb656 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.371031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501ee4b-2d96-4954-b71d-4c54a33fb656 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.371374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6501ee4b-2d96-4954-b71d-4c54a33fb656 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.372305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501ee4b-2d96-4954-b71d-4c54a33fb656 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:53.374190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6501ee4b-2d96-4954-b71d-4c54a33fb656 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:53.390281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1191/2408] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:53.391614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e354f8-44c8-4e40-9bbb-9228acc435e7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:53.403575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1e354f8-44c8-4e40-9bbb-9228acc435e7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:53.413321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf4c3-51d1-423a-9bbf-1bb8f7a476c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:53.413321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf4c3-51d1-423a-9bbf-1bb8f7a476c0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.413321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf4c3-51d1-423a-9bbf-1bb8f7a476c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.413321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabcf4c3-51d1-423a-9bbf-1bb8f7a476c0 admin admin] PATH_INFO: `/v3/projects/1c13bc5c4e494121946aad792b29aab2/users/cf17eb7cc89c469e932d9ea6998b3cde/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.435592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcf4c3-51d1-423a-9bbf-1bb8f7a476c0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c13bc5c4e494121946aad792b29aab2, user_id=cf17eb7cc89c469e932d9ea6998b3cde, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:53.438755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabcf4c3-51d1-423a-9bbf-1bb8f7a476c0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:53.455284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1218/2409] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:53 2022] PUT /identity/v3/projects/1c13bc5c4e494121946aad792b29aab2/users/cf17eb7cc89c469e932d9ea6998b3cde/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:53.460055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501ee4b-2d96-4954-b71d-4c54a33fb656 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:53.471275 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6501ee4b-2d96-4954-b71d-4c54a33fb656 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:53.480122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:53.547733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef764880-42f2-4496-a531-fb064b5fb2cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:53.548526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764880-42f2-4496-a531-fb064b5fb2cb admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.548879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764880-42f2-4496-a531-fb064b5fb2cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.549219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef764880-42f2-4496-a531-fb064b5fb2cb admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.550048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef764880-42f2-4496-a531-fb064b5fb2cb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:53.552692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef764880-42f2-4496-a531-fb064b5fb2cb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:53.563742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1192/2410] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:53 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:53.568432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf4c3-51d1-423a-9bbf-1bb8f7a476c0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:53.580444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabcf4c3-51d1-423a-9bbf-1bb8f7a476c0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:53.586141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:53.586999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.587279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.587548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] PATH_INFO: `/v3/projects/1c13bc5c4e494121946aad792b29aab2/users/cf17eb7cc89c469e932d9ea6998b3cde/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.590057 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] RBAC: Authorizing `identity:create_grant(project_id=1c13bc5c4e494121946aad792b29aab2, user_id=cf17eb7cc89c469e932d9ea6998b3cde, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:53.593214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:53.611743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1219/2411] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:53 2022] PUT /identity/v3/projects/1c13bc5c4e494121946aad792b29aab2/users/cf17eb7cc89c469e932d9ea6998b3cde/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:42:53.684834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8f18-09f1-46cc-bff8-1c169ccd8287 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.686755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8f18-09f1-46cc-bff8-1c169ccd8287 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.687107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bc8f18-09f1-46cc-bff8-1c169ccd8287 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.738664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c9bc8f18-09f1-46cc-bff8-1c169ccd8287 None None] MFA Rules not processed for user `cf17eb7cc89c469e932d9ea6998b3cde`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:53.740276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c9bc8f18-09f1-46cc-bff8-1c169ccd8287 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:53.813243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1193/2412] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:53 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:53.824546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:53.826306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:53.894175 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd4248c-560f-4876-8a02-56e93401ce9c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:53.898370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:53.899066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.899355 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.899625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:53.915099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:53.918971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:53.931896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1220/2413] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:53 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:53.979356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8f18-09f1-46cc-bff8-1c169ccd8287 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:53.988806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9bc8f18-09f1-46cc-bff8-1c169ccd8287 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:53.992436 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a386c6-2a6f-45d8-a7ef-13e8132dd93a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:53.993066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a386c6-2a6f-45d8-a7ef-13e8132dd93a service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:53.993344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a386c6-2a6f-45d8-a7ef-13e8132dd93a service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:53.993651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a386c6-2a6f-45d8-a7ef-13e8132dd93a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:54.051060 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a386c6-2a6f-45d8-a7ef-13e8132dd93a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:54.053041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a386c6-2a6f-45d8-a7ef-13e8132dd93a service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:54.062272 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1194/2414] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:53 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:54.420510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:54.422420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:54.463087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:54.481152 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c426dc1-8929-416f-a910-192884188728 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:54.484623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:54.485255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:54.485636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:54.485905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:54.487644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:54.556388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:54.557884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:54.567339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1221/2415] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:56.078315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce99f4-d38d-47e6-abd0-73b3fc013950 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:56.078841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce99f4-d38d-47e6-abd0-73b3fc013950 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:56.078841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adce99f4-d38d-47e6-abd0-73b3fc013950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:56.105718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-adce99f4-d38d-47e6-abd0-73b3fc013950 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:56.106949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-adce99f4-d38d-47e6-abd0-73b3fc013950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:56.169078 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:56.216692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1195/2416] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 12 08:42:56 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:56.238835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:56.240672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:56.342627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f56eb-0ae2-4111-a2f3-114fe73fd98b service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:56.348841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079c5aad-586c-429e-a461-4c08c0aebdee service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:56.349654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5aad-586c-429e-a461-4c08c0aebdee service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:56.353306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5aad-586c-429e-a461-4c08c0aebdee service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:56.353715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079c5aad-586c-429e-a461-4c08c0aebdee service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:56.372651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c5aad-586c-429e-a461-4c08c0aebdee service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:56.374397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079c5aad-586c-429e-a461-4c08c0aebdee service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:56.384313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1222/2417] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:42:56 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:42:57.576093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce99f4-d38d-47e6-abd0-73b3fc013950 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:57.592284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adce99f4-d38d-47e6-abd0-73b3fc013950 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:57.597174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:57.598027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:57.598430 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:57.598791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] PATH_INFO: `/v3/users/19ca43a4f9164dbb8478a3767f1410c6` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:57.600010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19ca43a4f9164dbb8478a3767f1410c6)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:57.602211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:57.683879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19ca43a4f9164dbb8478a3767f1410c6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:57.703735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19ca43a4f9164dbb8478a3767f1410c6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:57.711497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19ca43a4f9164dbb8478a3767f1410c6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:57.718821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19ca43a4f9164dbb8478a3767f1410c6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:57.719516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19ca43a4f9164dbb8478a3767f1410c6'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:57.726570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1196/2418] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:57 2022] DELETE /identity/v3/users/19ca43a4f9164dbb8478a3767f1410c6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:57.731053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f484c-6536-4800-8808-1620d7820647 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:57.731561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f484c-6536-4800-8808-1620d7820647 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:57.731853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-558f484c-6536-4800-8808-1620d7820647 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:57.752142 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-558f484c-6536-4800-8808-1620d7820647 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:57.753370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-558f484c-6536-4800-8808-1620d7820647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:57.815354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1223/2419] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:57.826019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:57.827441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:57.920012 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601d7b01-abf2-45e0-b3e8-57461e9e0138 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:57.930393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:57.931471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:57.931849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:57.933704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:57.957374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:57.959194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:57.973690 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1197/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:42:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:42:58.221054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f484c-6536-4800-8808-1620d7820647 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:58.224074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-558f484c-6536-4800-8808-1620d7820647 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:58.241384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-558f484c-6536-4800-8808-1620d7820647 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:58.250727 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:58.252028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:58.252597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:58.253100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] PATH_INFO: `/v3/users/e037c38a998240b293910049cfe37799` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:58.255093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e037c38a998240b293910049cfe37799)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:58.257606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:58.269310 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:58.326826 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e037c38a998240b293910049cfe37799'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.335279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e037c38a998240b293910049cfe37799'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.343550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e037c38a998240b293910049cfe37799'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.364119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e037c38a998240b293910049cfe37799'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.364814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e037c38a998240b293910049cfe37799'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.372370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1224/2421] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:58 2022] DELETE /identity/v3/users/e037c38a998240b293910049cfe37799 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:58.474999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:58.476633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:58.493358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba180e65-d953-43ab-8ee5-122e6d4eaccc service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:58.562104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:58.578599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:58.580788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:58.581317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:58.581808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] PATH_INFO: `/v3/projects/cd5e3fb2f77740759c3d8b5ce316ca93` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:58.584078 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd5e3fb2f77740759c3d8b5ce316ca93)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:58.586876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:58.631343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:58.633829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:58.649955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8515df8f-e4e7-41fe-b3a2-fcf7f24c9255 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:58.670603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd5e3fb2f77740759c3d8b5ce316ca93', 'request_id': 'req-f910b622-ea90-4e0a-80ed-3b0e07c39b43'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.679910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd5e3fb2f77740759c3d8b5ce316ca93', 'request_id': 'req-f910b622-ea90-4e0a-80ed-3b0e07c39b43'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.692580 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd5e3fb2f77740759c3d8b5ce316ca93', 'request_id': 'req-f910b622-ea90-4e0a-80ed-3b0e07c39b43'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.710136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] The token cache is being invalidate because project cd5e3fb2f77740759c3d8b5ce316ca93 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:58.710529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.711481 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.717113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1198/2422] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:58 2022] DELETE /identity/v3/projects/cd5e3fb2f77740759c3d8b5ce316ca93 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:58.718044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:58.719838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:58.730978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:58.731917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:58.732458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:58.732458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] PATH_INFO: `/v3/projects/da102ca6c6b5463a8ebc237d9eb8dfae` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:58.733777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da102ca6c6b5463a8ebc237d9eb8dfae)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:58.735701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:58.791042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f910b622-ea90-4e0a-80ed-3b0e07c39b43 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:58.795641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da102ca6c6b5463a8ebc237d9eb8dfae', 'request_id': 'req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.803562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da102ca6c6b5463a8ebc237d9eb8dfae', 'request_id': 'req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.812236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da102ca6c6b5463a8ebc237d9eb8dfae', 'request_id': 'req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.823847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] The token cache is being invalidate because project da102ca6c6b5463a8ebc237d9eb8dfae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:58.824123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.824740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-8011c0a7-ba1e-4658-a808-04ff6b36b8d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.826562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1225/2423] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:58 2022] DELETE /identity/v3/projects/da102ca6c6b5463a8ebc237d9eb8dfae => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:58.831136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eb5b0-459c-4034-9683-f52a1f84d86b None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:58.831427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eb5b0-459c-4034-9683-f52a1f84d86b None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:58.831726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-783eb5b0-459c-4034-9683-f52a1f84d86b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:58.850757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-783eb5b0-459c-4034-9683-f52a1f84d86b None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:58.851955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-783eb5b0-459c-4034-9683-f52a1f84d86b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:58.858187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:58.859052 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:58.859328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:58.859599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] PATH_INFO: `/v3/users/cf17eb7cc89c469e932d9ea6998b3cde` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:58.861041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cf17eb7cc89c469e932d9ea6998b3cde)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:58.863001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:58.864368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:58.899151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:58.915314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cf17eb7cc89c469e932d9ea6998b3cde'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.918253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1226/2424] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:58.926573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e4c1-7302-4bb7-a183-09b18fd83cbc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:58.926862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e4c1-7302-4bb7-a183-09b18fd83cbc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:58.927137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb78e4c1-7302-4bb7-a183-09b18fd83cbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:58.928494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cf17eb7cc89c469e932d9ea6998b3cde'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.939915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cf17eb7cc89c469e932d9ea6998b3cde'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.945504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-fb78e4c1-7302-4bb7-a183-09b18fd83cbc None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:58.946710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-fb78e4c1-7302-4bb7-a183-09b18fd83cbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:58.948005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cf17eb7cc89c469e932d9ea6998b3cde'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.948732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cf17eb7cc89c469e932d9ea6998b3cde'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:58.954555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1227/2425] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:42:58.955118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1199/2426] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:42:58 2022] DELETE /identity/v3/users/cf17eb7cc89c469e932d9ea6998b3cde => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:58.962664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e4c1-7302-4bb7-a183-09b18fd83cbc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:58.973905 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb78e4c1-7302-4bb7-a183-09b18fd83cbc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.034435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.035109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.035379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.035670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.036394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:42:59.036700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.038350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.050407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1228/2427] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:42:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:42:59.055010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.065296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2987f5ac-3e83-4a40-95b5-250c1a574ef9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.070563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2a906-0202-4935-beed-9a56d13e34c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.071216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2a906-0202-4935-beed-9a56d13e34c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.071496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2a906-0202-4935-beed-9a56d13e34c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.071763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ea2a906-0202-4935-beed-9a56d13e34c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.072447 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2a906-0202-4935-beed-9a56d13e34c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.074396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ea2a906-0202-4935-beed-9a56d13e34c0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.102434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1200/2428] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/projects => generated 387 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:59.106501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.121844 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f04f96f8-c004-422d-bf56-e3c83be8c81b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.183131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.183794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.184070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.184337 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.185033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.187051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.208120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1229/2429] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/users => generated 294 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:42:59.211959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2a906-0202-4935-beed-9a56d13e34c0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.225693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ea2a906-0202-4935-beed-9a56d13e34c0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.231160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e84479-209e-43fb-8df3-480092926f3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.231975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84479-209e-43fb-8df3-480092926f3a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.232267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84479-209e-43fb-8df3-480092926f3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.232560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e84479-209e-43fb-8df3-480092926f3a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.233810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e84479-209e-43fb-8df3-480092926f3a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.236376 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e84479-209e-43fb-8df3-480092926f3a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.245454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.247168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:59.251844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1201/2430] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:42:59.255740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e84479-209e-43fb-8df3-480092926f3a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.263183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaed507-b9ac-42ca-89ca-eb329a3f631c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.265665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e84479-209e-43fb-8df3-480092926f3a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.267829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.268777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.269222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.269536 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] PATH_INFO: `/v3/projects/1c13bc5c4e494121946aad792b29aab2` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.271427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1c13bc5c4e494121946aad792b29aab2)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.273213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddf51f-f64c-4eec-bb10-6a73338b9932 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.273446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.273884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddf51f-f64c-4eec-bb10-6a73338b9932 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.274172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddf51f-f64c-4eec-bb10-6a73338b9932 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.274584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03ddf51f-f64c-4eec-bb10-6a73338b9932 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.275527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddf51f-f64c-4eec-bb10-6a73338b9932 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.277825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03ddf51f-f64c-4eec-bb10-6a73338b9932 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.292463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1202/2431] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:42:59.293685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddf51f-f64c-4eec-bb10-6a73338b9932 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.303803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03ddf51f-f64c-4eec-bb10-6a73338b9932 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.308510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcede65-a37e-461b-ad76-cea170b084ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.309380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcede65-a37e-461b-ad76-cea170b084ba admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.309536 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:59.309689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcede65-a37e-461b-ad76-cea170b084ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.310172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcede65-a37e-461b-ad76-cea170b084ba admin admin] PATH_INFO: `/v3/projects/701d91adeb0244c6a5a4a1c363fa1e8f/users/8017af7f297942df98d0ca0d975ad1aa/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.324835 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcede65-a37e-461b-ad76-cea170b084ba admin admin] RBAC: Authorizing `identity:create_grant(project_id=701d91adeb0244c6a5a4a1c363fa1e8f, user_id=8017af7f297942df98d0ca0d975ad1aa, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.326106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1c13bc5c4e494121946aad792b29aab2', 'request_id': 'req-e876d06e-d318-4d21-8a00-1a5673af6a44'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:59.327536 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcede65-a37e-461b-ad76-cea170b084ba admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.334769 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1c13bc5c4e494121946aad792b29aab2', 'request_id': 'req-e876d06e-d318-4d21-8a00-1a5673af6a44'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:59.342310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1203/2432] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:59 2022] PUT /identity/v3/projects/701d91adeb0244c6a5a4a1c363fa1e8f/users/8017af7f297942df98d0ca0d975ad1aa/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:42:59.347969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1c13bc5c4e494121946aad792b29aab2', 'request_id': 'req-e876d06e-d318-4d21-8a00-1a5673af6a44'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:59.353543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79295b1-027b-4aaf-9bd0-1733dbeb659f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.353837 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79295b1-027b-4aaf-9bd0-1733dbeb659f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.354243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79295b1-027b-4aaf-9bd0-1733dbeb659f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.359451 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] The token cache is being invalidate because project 1c13bc5c4e494121946aad792b29aab2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:42:59.359917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:59.361397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e876d06e-d318-4d21-8a00-1a5673af6a44 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:42:59.362987 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1230/2433] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:42:59 2022] DELETE /identity/v3/projects/1c13bc5c4e494121946aad792b29aab2 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:42:59.367581 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b495d-025b-4084-9c50-85be42c44271 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.367875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b495d-025b-4084-9c50-85be42c44271 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.368148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d31b495d-025b-4084-9c50-85be42c44271 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.379948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-a79295b1-027b-4aaf-9bd0-1733dbeb659f None None] MFA Rules not processed for user `8017af7f297942df98d0ca0d975ad1aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:59.381170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a79295b1-027b-4aaf-9bd0-1733dbeb659f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:59.386547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d31b495d-025b-4084-9c50-85be42c44271 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:59.387738 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d31b495d-025b-4084-9c50-85be42c44271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:59.453047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1231/2434] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:42:59.457168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1204/2435] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:42:59.462166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b495d-025b-4084-9c50-85be42c44271 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.463891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d31b495d-025b-4084-9c50-85be42c44271 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:59.464693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66542-09d1-4995-8a60-7eb44f33decc None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.464985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66542-09d1-4995-8a60-7eb44f33decc None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.465394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9b66542-09d1-4995-8a60-7eb44f33decc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.475847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d31b495d-025b-4084-9c50-85be42c44271 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.480381 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0fe3-01b9-4485-978f-91eefc4acb9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.481022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0fe3-01b9-4485-978f-91eefc4acb9d admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.481301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0fe3-01b9-4485-978f-91eefc4acb9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.481604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c3a0fe3-01b9-4485-978f-91eefc4acb9d admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.482308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0fe3-01b9-4485-978f-91eefc4acb9d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.483535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-d9b66542-09d1-4995-8a60-7eb44f33decc None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:59.484209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c3a0fe3-01b9-4485-978f-91eefc4acb9d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.484728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d9b66542-09d1-4995-8a60-7eb44f33decc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:59.492896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1205/2436] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:42:59.496885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b66542-09d1-4995-8a60-7eb44f33decc None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.506395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9b66542-09d1-4995-8a60-7eb44f33decc None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.513746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1232/2437] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/projects => generated 385 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:59.513879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.513879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.513879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.513879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.514212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:42:59.514212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.514653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0fe3-01b9-4485-978f-91eefc4acb9d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.514981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.527454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1206/2438] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:42:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:42:59.537468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.547388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9e90fc-93fc-40aa-a0dc-f0150e71780d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.552167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=5,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:59.580868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c3a0fe3-01b9-4485-978f-91eefc4acb9d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.586365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729374c-8191-448d-a9a0-cba7b4c1ac39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.587033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729374c-8191-448d-a9a0-cba7b4c1ac39 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.587340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729374c-8191-448d-a9a0-cba7b4c1ac39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.587608 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5729374c-8191-448d-a9a0-cba7b4c1ac39 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.588284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729374c-8191-448d-a9a0-cba7b4c1ac39 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.590232 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5729374c-8191-448d-a9a0-cba7b4c1ac39 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.606850 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4481ae-4697-4052-bd3b-d63fcfcbd6b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.607507 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4481ae-4697-4052-bd3b-d63fcfcbd6b8 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.607787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4481ae-4697-4052-bd3b-d63fcfcbd6b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.608057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f4481ae-4697-4052-bd3b-d63fcfcbd6b8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.608737 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4481ae-4697-4052-bd3b-d63fcfcbd6b8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.610617 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1233/2439] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/users => generated 299 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:42:59.610736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f4481ae-4697-4052-bd3b-d63fcfcbd6b8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.615416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729374c-8191-448d-a9a0-cba7b4c1ac39 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.625567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5729374c-8191-448d-a9a0-cba7b4c1ac39 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.631677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cc91d-47c4-4c74-894f-ab6ca51d2ac7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.632326 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc91d-47c4-4c74-894f-ab6ca51d2ac7 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.632607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc91d-47c4-4c74-894f-ab6ca51d2ac7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.632881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1cc91d-47c4-4c74-894f-ab6ca51d2ac7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.633648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cc91d-47c4-4c74-894f-ab6ca51d2ac7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.635239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f1cc91d-47c4-4c74-894f-ab6ca51d2ac7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.640775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1207/2440] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/projects => generated 385 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:42:59.642331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4481ae-4697-4052-bd3b-d63fcfcbd6b8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.649064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1234/2441] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:42:59.650138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cc91d-47c4-4c74-894f-ab6ca51d2ac7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.661339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1cc91d-47c4-4c74-894f-ab6ca51d2ac7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.673908 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:59.707366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f4481ae-4697-4052-bd3b-d63fcfcbd6b8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.712276 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37bca4-604a-44d7-8331-8a3e75cb661e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.712944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37bca4-604a-44d7-8331-8a3e75cb661e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.713232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37bca4-604a-44d7-8331-8a3e75cb661e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.713531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e37bca4-604a-44d7-8331-8a3e75cb661e admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.714223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37bca4-604a-44d7-8331-8a3e75cb661e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.716147 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e37bca4-604a-44d7-8331-8a3e75cb661e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.721605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c347e-c284-4282-81c4-b7b8d4a3ef43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.722620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c347e-c284-4282-81c4-b7b8d4a3ef43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.723857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c347e-c284-4282-81c4-b7b8d4a3ef43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.723857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f83c347e-c284-4282-81c4-b7b8d4a3ef43 admin admin] PATH_INFO: `/v3/projects/2d1ad84ac0d044f8b40e919a9a741abf/users/ce6e9f5b413b4c4a9556b3f9ed7623dc/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.738640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1208/2442] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:42:59.742427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c347e-c284-4282-81c4-b7b8d4a3ef43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1ad84ac0d044f8b40e919a9a741abf, user_id=ce6e9f5b413b4c4a9556b3f9ed7623dc, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.743334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37bca4-604a-44d7-8331-8a3e75cb661e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.743474 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f83c347e-c284-4282-81c4-b7b8d4a3ef43 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.753407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e37bca4-604a-44d7-8331-8a3e75cb661e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.757764 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1235/2443] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:59 2022] PUT /identity/v3/projects/2d1ad84ac0d044f8b40e919a9a741abf/users/ce6e9f5b413b4c4a9556b3f9ed7623dc/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:42:59.761660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c347e-c284-4282-81c4-b7b8d4a3ef43 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.814116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a7b05-28ec-43e7-bfb7-f534a159028c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.814778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a7b05-28ec-43e7-bfb7-f534a159028c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.815058 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a7b05-28ec-43e7-bfb7-f534a159028c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.815330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a7b05-28ec-43e7-bfb7-f534a159028c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.816052 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a7b05-28ec-43e7-bfb7-f534a159028c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.818300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a7b05-28ec-43e7-bfb7-f534a159028c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.828489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1209/2444] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:59.832782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a7b05-28ec-43e7-bfb7-f534a159028c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.833861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f83c347e-c284-4282-81c4-b7b8d4a3ef43 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.839418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f7e4-1180-4ace-8877-eb3c4d6f5f0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.840656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f7e4-1180-4ace-8877-eb3c4d6f5f0e admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.840938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f7e4-1180-4ace-8877-eb3c4d6f5f0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.841366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e400f7e4-1180-4ace-8877-eb3c4d6f5f0e admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.842118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400f7e4-1180-4ace-8877-eb3c4d6f5f0e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.843708 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e400f7e4-1180-4ace-8877-eb3c4d6f5f0e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.843891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a7b05-28ec-43e7-bfb7-f534a159028c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.849455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49346b59-eed0-4db5-b146-e4f83a989dbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.850004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346b59-eed0-4db5-b146-e4f83a989dbf admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.850279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346b59-eed0-4db5-b146-e4f83a989dbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.850592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49346b59-eed0-4db5-b146-e4f83a989dbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.851670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49346b59-eed0-4db5-b146-e4f83a989dbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.853258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49346b59-eed0-4db5-b146-e4f83a989dbf admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.855378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1236/2445] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:59.859353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f7e4-1180-4ace-8877-eb3c4d6f5f0e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.864632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1210/2446] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:42:59 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:42:59.868664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49346b59-eed0-4db5-b146-e4f83a989dbf admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:42:59.871791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e400f7e4-1180-4ace-8877-eb3c4d6f5f0e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.877256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5600062-ed86-4e7f-bbcb-e943573340b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.878401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5600062-ed86-4e7f-bbcb-e943573340b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.878614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49346b59-eed0-4db5-b146-e4f83a989dbf admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:42:59.878828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5600062-ed86-4e7f-bbcb-e943573340b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.879248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5600062-ed86-4e7f-bbcb-e943573340b8 admin admin] PATH_INFO: `/v3/projects/2d1ad84ac0d044f8b40e919a9a741abf/users/ce6e9f5b413b4c4a9556b3f9ed7623dc/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.882589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5600062-ed86-4e7f-bbcb-e943573340b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2d1ad84ac0d044f8b40e919a9a741abf, user_id=ce6e9f5b413b4c4a9556b3f9ed7623dc, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.884924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5600062-ed86-4e7f-bbcb-e943573340b8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.896315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7026903-823a-46f7-8980-d654588ccf6e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:42:59.898174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7026903-823a-46f7-8980-d654588ccf6e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.898735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7026903-823a-46f7-8980-d654588ccf6e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.899193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7026903-823a-46f7-8980-d654588ccf6e admin admin] PATH_INFO: `/v3/projects/161d145efa184875a1b5064ad700d4d7/users/b94f793f6ea84e039a144e2fee3de2ce/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.902558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1237/2447] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:59 2022] PUT /identity/v3/projects/2d1ad84ac0d044f8b40e919a9a741abf/users/ce6e9f5b413b4c4a9556b3f9ed7623dc/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 43 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:42:59.903881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:42:59.912707 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2e94-6c3b-4e2f-b67c-635cf06a5053 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.912994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2e94-6c3b-4e2f-b67c-635cf06a5053 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.913370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e8a2e94-6c3b-4e2f-b67c-635cf06a5053 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.921351 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7026903-823a-46f7-8980-d654588ccf6e admin admin] RBAC: Authorizing `identity:create_grant(project_id=161d145efa184875a1b5064ad700d4d7, user_id=b94f793f6ea84e039a144e2fee3de2ce, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:42:59.926405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7026903-823a-46f7-8980-d654588ccf6e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:42:59.948431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1211/2448] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:42:59 2022] PUT /identity/v3/projects/161d145efa184875a1b5064ad700d4d7/users/b94f793f6ea84e039a144e2fee3de2ce/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:42:59.949563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8e8a2e94-6c3b-4e2f-b67c-635cf06a5053 None None] MFA Rules not processed for user `ce6e9f5b413b4c4a9556b3f9ed7623dc`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:59.950874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8e8a2e94-6c3b-4e2f-b67c-635cf06a5053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:42:59.960754 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a26d-77e7-4aae-8306-821db08c0bd4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:42:59.960966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a26d-77e7-4aae-8306-821db08c0bd4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:42:59.961387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e889a26d-77e7-4aae-8306-821db08c0bd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:42:59.993938 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e889a26d-77e7-4aae-8306-821db08c0bd4 None None] MFA Rules not processed for user `b94f793f6ea84e039a144e2fee3de2ce`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:42:59.995382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e889a26d-77e7-4aae-8306-821db08c0bd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:00.038123 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1238/2449] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:00.050521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a2e94-6c3b-4e2f-b67c-635cf06a5053 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.053464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8e8a2e94-6c3b-4e2f-b67c-635cf06a5053 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:00.064085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:00.065952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1212/2450] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:42:59 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:00.071016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a26d-77e7-4aae-8306-821db08c0bd4 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.115248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e8a2e94-6c3b-4e2f-b67c-635cf06a5053 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.119273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f22240-95c8-4cd4-a929-ad09775ac336 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.119923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f22240-95c8-4cd4-a929-ad09775ac336 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.120204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f22240-95c8-4cd4-a929-ad09775ac336 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.120477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f22240-95c8-4cd4-a929-ad09775ac336 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.129677 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f22240-95c8-4cd4-a929-ad09775ac336 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.131558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f22240-95c8-4cd4-a929-ad09775ac336 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.133069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e889a26d-77e7-4aae-8306-821db08c0bd4 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.137679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f553a4-709b-4523-b2d8-26112b99f7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.138324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f553a4-709b-4523-b2d8-26112b99f7a7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.138603 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f553a4-709b-4523-b2d8-26112b99f7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.138876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f553a4-709b-4523-b2d8-26112b99f7a7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.139566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f553a4-709b-4523-b2d8-26112b99f7a7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.141122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1239/2451] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:00 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:00.141819 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f553a4-709b-4523-b2d8-26112b99f7a7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.168377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1213/2452] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:00 2022] POST /identity/v3/projects => generated 385 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:00.178428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f22240-95c8-4cd4-a929-ad09775ac336 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.189148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f22240-95c8-4cd4-a929-ad09775ac336 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.205800 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f553a4-709b-4523-b2d8-26112b99f7a7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.250919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3294e-d121-44f1-a85c-c0b4a7d1163e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.251505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3294e-d121-44f1-a85c-c0b4a7d1163e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.251789 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3294e-d121-44f1-a85c-c0b4a7d1163e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.252059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c3294e-d121-44f1-a85c-c0b4a7d1163e admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.252878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3294e-d121-44f1-a85c-c0b4a7d1163e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.255244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c3294e-d121-44f1-a85c-c0b4a7d1163e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.278551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f553a4-709b-4523-b2d8-26112b99f7a7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.279035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1240/2453] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:00 2022] POST /identity/v3/users => generated 299 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:00.282616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3294e-d121-44f1-a85c-c0b4a7d1163e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.283465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.284358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.284687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.284922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] PATH_INFO: `/v3/users/8017af7f297942df98d0ca0d975ad1aa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.286205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8017af7f297942df98d0ca0d975ad1aa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.288190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.289868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:00.294431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c3294e-d121-44f1-a85c-c0b4a7d1163e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.299797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53e1ec-ebe8-446d-b53a-ed30245bfe27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.300682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53e1ec-ebe8-446d-b53a-ed30245bfe27 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.301114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53e1ec-ebe8-446d-b53a-ed30245bfe27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.302323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e53e1ec-ebe8-446d-b53a-ed30245bfe27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.303234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53e1ec-ebe8-446d-b53a-ed30245bfe27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.305679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e53e1ec-ebe8-446d-b53a-ed30245bfe27 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.316526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1241/2454] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:43:00.321504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53e1ec-ebe8-446d-b53a-ed30245bfe27 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.333239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e53e1ec-ebe8-446d-b53a-ed30245bfe27 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.339143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.340133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.340412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.340682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] PATH_INFO: `/v3/projects/99e771f887bb4a489da3c1f6c429b2b0/users/71aa1799d36e47d58267680007db70aa/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.353815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8017af7f297942df98d0ca0d975ad1aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:00.366364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e771f887bb4a489da3c1f6c429b2b0, user_id=71aa1799d36e47d58267680007db70aa, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.370023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8017af7f297942df98d0ca0d975ad1aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:00.374267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.375533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8017af7f297942df98d0ca0d975ad1aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:00.385999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8017af7f297942df98d0ca0d975ad1aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:00.387119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-0e9f9533-a868-42b9-a671-70cc951abb12 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8017af7f297942df98d0ca0d975ad1aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:00.394566 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1214/2455] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:00 2022] DELETE /identity/v3/users/8017af7f297942df98d0ca0d975ad1aa => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:00.399365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b9249-bd81-42c3-ab37-1c50ab7bf2d1 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.399939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b9249-bd81-42c3-ab37-1c50ab7bf2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.400380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4b9249-bd81-42c3-ab37-1c50ab7bf2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.402308 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1242/2456] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:00 2022] PUT /identity/v3/projects/99e771f887bb4a489da3c1f6c429b2b0/users/71aa1799d36e47d58267680007db70aa/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:00.406016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.407704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:00.422491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2e4b9249-bd81-42c3-ab37-1c50ab7bf2d1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:00.424591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e4b9249-bd81-42c3-ab37-1c50ab7bf2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:00.483171 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdcb0c7-d4da-455f-9d87-4b3c6304e3db admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.493161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:00.493782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1215/2457] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:00.506283 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b9249-bd81-42c3-ab37-1c50ab7bf2d1 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.508995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2e4b9249-bd81-42c3-ab37-1c50ab7bf2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:00.548504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e28ad-e5b2-4f88-93a7-cd75933e3625 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.549174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e28ad-e5b2-4f88-93a7-cd75933e3625 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.549486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e28ad-e5b2-4f88-93a7-cd75933e3625 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.549761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-280e28ad-e5b2-4f88-93a7-cd75933e3625 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.550482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e28ad-e5b2-4f88-93a7-cd75933e3625 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.552857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-280e28ad-e5b2-4f88-93a7-cd75933e3625 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.563830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1243/2458] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:00 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:00.569127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e28ad-e5b2-4f88-93a7-cd75933e3625 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.581743 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-280e28ad-e5b2-4f88-93a7-cd75933e3625 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.581987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4b9249-bd81-42c3-ab37-1c50ab7bf2d1 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.587158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf8a357-deb7-4c58-923a-72b86e196930 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.587422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.588048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a357-deb7-4c58-923a-72b86e196930 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.588324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.588432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a357-deb7-4c58-923a-72b86e196930 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.588597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf8a357-deb7-4c58-923a-72b86e196930 admin admin] PATH_INFO: `/v3/projects/99e771f887bb4a489da3c1f6c429b2b0/users/71aa1799d36e47d58267680007db70aa/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.588793 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.589144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.590774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8a357-deb7-4c58-923a-72b86e196930 admin admin] RBAC: Authorizing `identity:create_grant(project_id=99e771f887bb4a489da3c1f6c429b2b0, user_id=71aa1799d36e47d58267680007db70aa, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.593560 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf8a357-deb7-4c58-923a-72b86e196930 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.600681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.602658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.610289 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1244/2459] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:00 2022] PUT /identity/v3/projects/99e771f887bb4a489da3c1f6c429b2b0/users/71aa1799d36e47d58267680007db70aa/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:00.616929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799acc61-93b1-4446-ae2d-11d3c13414d2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.617293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799acc61-93b1-4446-ae2d-11d3c13414d2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.617882 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799acc61-93b1-4446-ae2d-11d3c13414d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.618033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1216/2460] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:00.648614 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-799acc61-93b1-4446-ae2d-11d3c13414d2 None None] MFA Rules not processed for user `71aa1799d36e47d58267680007db70aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:00.649987 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-799acc61-93b1-4446-ae2d-11d3c13414d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:00.763226 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1245/2461] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:00 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:00.775306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:00.777174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:00.813531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:00.848184 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bc6de8-eb52-4fec-a483-2751d5a486f1 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:00.904874 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:00.905595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:00.905879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:00.906155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:00.907993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:00.972679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:00.974483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:00.985646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1217/2462] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:00 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:01.087584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799acc61-93b1-4446-ae2d-11d3c13414d2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:01.088999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-799acc61-93b1-4446-ae2d-11d3c13414d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:01.204426 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799acc61-93b1-4446-ae2d-11d3c13414d2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:01.210083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:01.211143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:01.211490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:01.211869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] PATH_INFO: `/v3/projects/701d91adeb0244c6a5a4a1c363fa1e8f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:01.213140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] RBAC: Authorizing `identity:delete_project(project_id=701d91adeb0244c6a5a4a1c363fa1e8f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:01.215235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:01.241736 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:01.272424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '701d91adeb0244c6a5a4a1c363fa1e8f', 'request_id': 'req-dcdac580-d91c-4c13-8757-484b3337ea39'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.280359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '701d91adeb0244c6a5a4a1c363fa1e8f', 'request_id': 'req-dcdac580-d91c-4c13-8757-484b3337ea39'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.291469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '701d91adeb0244c6a5a4a1c363fa1e8f', 'request_id': 'req-dcdac580-d91c-4c13-8757-484b3337ea39'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.304847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] The token cache is being invalidate because project 701d91adeb0244c6a5a4a1c363fa1e8f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:01.305157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.305911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.307550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1246/2463] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:01 2022] DELETE /identity/v3/projects/701d91adeb0244c6a5a4a1c363fa1e8f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:01.311542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:01.324866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d17448ae-0bfa-4f83-a74a-e5c32e8fbe88 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:01.491968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:01.492947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:01.493227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:01.493584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] PATH_INFO: `/v3/users/ce6e9f5b413b4c4a9556b3f9ed7623dc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:01.494888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ce6e9f5b413b4c4a9556b3f9ed7623dc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:01.496877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:01.559424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:01.595406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ce6e9f5b413b4c4a9556b3f9ed7623dc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.632751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ce6e9f5b413b4c4a9556b3f9ed7623dc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.642255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ce6e9f5b413b4c4a9556b3f9ed7623dc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.650779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ce6e9f5b413b4c4a9556b3f9ed7623dc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.652432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e41d4685-1db0-4508-a911-f8c7c1fa9cb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ce6e9f5b413b4c4a9556b3f9ed7623dc'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:01.663388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1218/2464] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:01 2022] DELETE /identity/v3/users/ce6e9f5b413b4c4a9556b3f9ed7623dc => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:01.965661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:01.967695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:01.981377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdac580-d91c-4c13-8757-484b3337ea39 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:02.043768 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:02.044846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.045234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.045650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] PATH_INFO: `/v3/projects/2d1ad84ac0d044f8b40e919a9a741abf` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.047000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2d1ad84ac0d044f8b40e919a9a741abf)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:02.049034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:02.102484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2d1ad84ac0d044f8b40e919a9a741abf', 'request_id': 'req-80fab2d4-315a-47da-b212-abcb4b63a094'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:02.108597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2d1ad84ac0d044f8b40e919a9a741abf', 'request_id': 'req-80fab2d4-315a-47da-b212-abcb4b63a094'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:02.117231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2d1ad84ac0d044f8b40e919a9a741abf', 'request_id': 'req-80fab2d4-315a-47da-b212-abcb4b63a094'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:02.128270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] The token cache is being invalidate because project 2d1ad84ac0d044f8b40e919a9a741abf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:02.128694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:02.129223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-80fab2d4-315a-47da-b212-abcb4b63a094 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:02.130911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1247/2465] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:01 2022] DELETE /identity/v3/projects/2d1ad84ac0d044f8b40e919a9a741abf => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:02.135823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b05b-30ed-4b6a-81d2-023469df9a21 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.136114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b05b-30ed-4b6a-81d2-023469df9a21 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.136396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2130b05b-30ed-4b6a-81d2-023469df9a21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.154609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-2130b05b-30ed-4b6a-81d2-023469df9a21 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:02.155812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-2130b05b-30ed-4b6a-81d2-023469df9a21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:02.242388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1219/2466] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:02.250481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80ab8-b7de-4a8b-8983-7ea7bfe02acc None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.250770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80ab8-b7de-4a8b-8983-7ea7bfe02acc None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.251047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b80ab8-b7de-4a8b-8983-7ea7bfe02acc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.272047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-43b80ab8-b7de-4a8b-8983-7ea7bfe02acc None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:02.273476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-43b80ab8-b7de-4a8b-8983-7ea7bfe02acc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:02.289251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130b05b-30ed-4b6a-81d2-023469df9a21 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:02.298569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1248/2467] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:02.300343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2130b05b-30ed-4b6a-81d2-023469df9a21 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:02.305881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:02.306832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.307117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.307398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.308145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:02.308457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:02.310150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:02.324672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1220/2468] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:43:02.328985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b80ab8-b7de-4a8b-8983-7ea7bfe02acc None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:02.342817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b80ab8-b7de-4a8b-8983-7ea7bfe02acc None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:02.348274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bcae0-344c-4909-8a2e-ecdf260f7e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:02.348942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcae0-344c-4909-8a2e-ecdf260f7e84 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.349219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcae0-344c-4909-8a2e-ecdf260f7e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.349531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536bcae0-344c-4909-8a2e-ecdf260f7e84 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.350224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bcae0-344c-4909-8a2e-ecdf260f7e84 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:02.352167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-536bcae0-344c-4909-8a2e-ecdf260f7e84 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:02.382742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1249/2469] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:02 2022] POST /identity/v3/projects => generated 373 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:02.386990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:02.407618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca23b7b-120d-4485-8204-a606431f7078 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:02.488375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca041a-bb96-417c-a825-6af12b3cbc3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:02.489619 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca041a-bb96-417c-a825-6af12b3cbc3d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.489904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca041a-bb96-417c-a825-6af12b3cbc3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.490176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceca041a-bb96-417c-a825-6af12b3cbc3d admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.490869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca041a-bb96-417c-a825-6af12b3cbc3d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:02.492864 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceca041a-bb96-417c-a825-6af12b3cbc3d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:02.521466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1221/2470] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:02 2022] POST /identity/v3/users => generated 287 bytes in 134 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:02.522019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bcae0-344c-4909-8a2e-ecdf260f7e84 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:02.538275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536bcae0-344c-4909-8a2e-ecdf260f7e84 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:02.544959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803968cc-7b58-4d99-b90b-9487a72a4694 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:02.545650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803968cc-7b58-4d99-b90b-9487a72a4694 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.546183 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803968cc-7b58-4d99-b90b-9487a72a4694 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.546775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803968cc-7b58-4d99-b90b-9487a72a4694 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.547189 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803968cc-7b58-4d99-b90b-9487a72a4694 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:02.548775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803968cc-7b58-4d99-b90b-9487a72a4694 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:02.555649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=14,keystone:SELECT=83,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:02.562566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1250/2471] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:02.566310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca041a-bb96-417c-a825-6af12b3cbc3d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:02.583035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceca041a-bb96-417c-a825-6af12b3cbc3d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:02.591230 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597880c4-c254-405a-955e-9c927ae7a992 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:02.592532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597880c4-c254-405a-955e-9c927ae7a992 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.592532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597880c4-c254-405a-955e-9c927ae7a992 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.592883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597880c4-c254-405a-955e-9c927ae7a992 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.593749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597880c4-c254-405a-955e-9c927ae7a992 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:02.595513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597880c4-c254-405a-955e-9c927ae7a992 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:02.611421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1222/2472] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:02 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:02.612706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803968cc-7b58-4d99-b90b-9487a72a4694 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:02.631403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803968cc-7b58-4d99-b90b-9487a72a4694 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:02.638150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:02.640012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.640312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.640961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] PATH_INFO: `/v3/projects/421791010ecd49ef8fedcfd0f354b08f/users/ceab30f3a25e4ece83b3512d37e623a1/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.658031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] RBAC: Authorizing `identity:create_grant(project_id=421791010ecd49ef8fedcfd0f354b08f, user_id=ceab30f3a25e4ece83b3512d37e623a1, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:02.662572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:02.686598 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1251/2473] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:02 2022] PUT /identity/v3/projects/421791010ecd49ef8fedcfd0f354b08f/users/ceab30f3a25e4ece83b3512d37e623a1/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:02.691489 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecc61-55e8-4717-b60d-c67c6a4d1f7c None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.692516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecc61-55e8-4717-b60d-c67c6a4d1f7c None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.692612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08ecc61-55e8-4717-b60d-c67c6a4d1f7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.713530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e08ecc61-55e8-4717-b60d-c67c6a4d1f7c None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:02.714778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e08ecc61-55e8-4717-b60d-c67c6a4d1f7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:02.729107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:02.804640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1223/2474] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:02.817771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:02.819939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:02.921270 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21cc0d68-44e8-4f45-9a22-6bd3a397255a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:02.927091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b56996-373e-4968-9b96-a1b598fda2eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:02.927939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b56996-373e-4968-9b96-a1b598fda2eb service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:02.928375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b56996-373e-4968-9b96-a1b598fda2eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:02.929302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33b56996-373e-4968-9b96-a1b598fda2eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:02.948242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b56996-373e-4968-9b96-a1b598fda2eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:02.950060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33b56996-373e-4968-9b96-a1b598fda2eb service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:02.961488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1252/2475] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:03.577357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea60a0-9a4e-4ce5-b2eb-97504fde1617 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:03.577677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea60a0-9a4e-4ce5-b2eb-97504fde1617 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:03.577959 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ea60a0-9a4e-4ce5-b2eb-97504fde1617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:03.607509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f2ea60a0-9a4e-4ce5-b2eb-97504fde1617 None None] MFA Rules not processed for user `ceab30f3a25e4ece83b3512d37e623a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:03.608739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f2ea60a0-9a4e-4ce5-b2eb-97504fde1617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:03.682781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1224/2476] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:03.687266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b56996-373e-4968-9b96-a1b598fda2eb service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:03.698305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33b56996-373e-4968-9b96-a1b598fda2eb service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:03.702830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac460-4d53-4af4-9e7e-ed27d0565624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:03.703469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac460-4d53-4af4-9e7e-ed27d0565624 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:03.703746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac460-4d53-4af4-9e7e-ed27d0565624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:03.704017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61ac460-4d53-4af4-9e7e-ed27d0565624 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:03.704700 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ac460-4d53-4af4-9e7e-ed27d0565624 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:03.706615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c61ac460-4d53-4af4-9e7e-ed27d0565624 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:03.735019 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1253/2477] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:03 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:03.739753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea60a0-9a4e-4ce5-b2eb-97504fde1617 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:03.751140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ea60a0-9a4e-4ce5-b2eb-97504fde1617 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:03.808427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51092cd-ee0d-4e8e-bb48-a8cfdc2df8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:03.809092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51092cd-ee0d-4e8e-bb48-a8cfdc2df8e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:03.809374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51092cd-ee0d-4e8e-bb48-a8cfdc2df8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:03.809680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51092cd-ee0d-4e8e-bb48-a8cfdc2df8e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:03.810368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51092cd-ee0d-4e8e-bb48-a8cfdc2df8e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:03.812285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51092cd-ee0d-4e8e-bb48-a8cfdc2df8e1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:03.831151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1225/2478] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:03 2022] POST /identity/v3/users => generated 292 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:03.836124 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac460-4d53-4af4-9e7e-ed27d0565624 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:03.846230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61ac460-4d53-4af4-9e7e-ed27d0565624 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:03.851660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fbb40-5104-4f7b-a22c-76e596065b50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:03.852302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbb40-5104-4f7b-a22c-76e596065b50 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:03.852580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbb40-5104-4f7b-a22c-76e596065b50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:03.852851 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266fbb40-5104-4f7b-a22c-76e596065b50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:03.853600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fbb40-5104-4f7b-a22c-76e596065b50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:03.855201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266fbb40-5104-4f7b-a22c-76e596065b50 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:03.866233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1254/2479] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:03.870394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51092cd-ee0d-4e8e-bb48-a8cfdc2df8e1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:03.881585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51092cd-ee0d-4e8e-bb48-a8cfdc2df8e1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:03.886130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600335-3c3c-402b-bc4b-2741879d1269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:03.887007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600335-3c3c-402b-bc4b-2741879d1269 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:03.887290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600335-3c3c-402b-bc4b-2741879d1269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:03.887572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5600335-3c3c-402b-bc4b-2741879d1269 admin admin] PATH_INFO: `/v3/projects/0dac64656afc408ea203df2b845d68f4/users/25c8ef98d71f4b719a7baea8b4007866/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:03.902660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600335-3c3c-402b-bc4b-2741879d1269 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dac64656afc408ea203df2b845d68f4, user_id=25c8ef98d71f4b719a7baea8b4007866, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:03.905361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5600335-3c3c-402b-bc4b-2741879d1269 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:03.917755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1226/2480] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:03 2022] PUT /identity/v3/projects/0dac64656afc408ea203df2b845d68f4/users/25c8ef98d71f4b719a7baea8b4007866/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:03.921748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fbb40-5104-4f7b-a22c-76e596065b50 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:03.932950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266fbb40-5104-4f7b-a22c-76e596065b50 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:03.991605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43411ba6-71c0-47c5-9bc3-f6309317f09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:03.992370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411ba6-71c0-47c5-9bc3-f6309317f09f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:03.992650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411ba6-71c0-47c5-9bc3-f6309317f09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:03.992927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43411ba6-71c0-47c5-9bc3-f6309317f09f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:03.993804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411ba6-71c0-47c5-9bc3-f6309317f09f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:03.995402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43411ba6-71c0-47c5-9bc3-f6309317f09f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:04.007517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1255/2481] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:03 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:04.011686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600335-3c3c-402b-bc4b-2741879d1269 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:04.023144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5600335-3c3c-402b-bc4b-2741879d1269 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:04.028655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:04.029674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:04.029960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:04.030231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] PATH_INFO: `/v3/projects/0dac64656afc408ea203df2b845d68f4/users/25c8ef98d71f4b719a7baea8b4007866/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:04.032249 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0dac64656afc408ea203df2b845d68f4, user_id=25c8ef98d71f4b719a7baea8b4007866, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:04.034970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:04.042239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:04.047185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1227/2482] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:04 2022] PUT /identity/v3/projects/0dac64656afc408ea203df2b845d68f4/users/25c8ef98d71f4b719a7baea8b4007866/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:04.739796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82040bfc-f41e-4c0b-ab3b-4e85c818a3b1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:04.740329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82040bfc-f41e-4c0b-ab3b-4e85c818a3b1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:04.740477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82040bfc-f41e-4c0b-ab3b-4e85c818a3b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:04.893132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-82040bfc-f41e-4c0b-ab3b-4e85c818a3b1 None None] MFA Rules not processed for user `25c8ef98d71f4b719a7baea8b4007866`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:04.894378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-82040bfc-f41e-4c0b-ab3b-4e85c818a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:04.925298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:04.964133 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1256/2483] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:04 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:04.975912 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:04.977677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:05.032711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4382d66-2bc8-43db-b6b3-dbeb616a8c81 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:05.036861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abd500-689b-437a-902b-1326d8265f96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:05.037523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd500-689b-437a-902b-1326d8265f96 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:05.037803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd500-689b-437a-902b-1326d8265f96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:05.038074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47abd500-689b-437a-902b-1326d8265f96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:05.092289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abd500-689b-437a-902b-1326d8265f96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:05.093767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47abd500-689b-437a-902b-1326d8265f96 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:05.103366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1228/2484] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:04 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:05.508453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82040bfc-f41e-4c0b-ab3b-4e85c818a3b1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:05.508453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-82040bfc-f41e-4c0b-ab3b-4e85c818a3b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:05.521870 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82040bfc-f41e-4c0b-ab3b-4e85c818a3b1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:05.525391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:05.526239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:05.526566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:05.527100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:05.528814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:05.599955 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:05.601691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:05.611850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1257/2485] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:05 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:06.449732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abd500-689b-437a-902b-1326d8265f96 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:06.458508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47abd500-689b-437a-902b-1326d8265f96 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:06.462189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:06.462814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:06.463092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:06.463368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:06.472137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:06.474332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:06.483510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1229/2486] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:06 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 34 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:06.721861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:06.723187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:06.778529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafc7be9-4f59-4c99-80b0-b39eedc64cc9 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:06.782059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:06.782684 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:06.782954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:06.783218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:06.784935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:06.845841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:06.847261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:06.856787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1258/2487] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 136 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:10.070019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:10.072052 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:10.170020 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:10.172256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:10.176666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a44483b7-a521-4557-8df5-610f0b3faff5 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:10.183266 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:10.184177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.184524 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.184803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.185572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7c9ca1-8de5-4714-9d34-ed391964f328 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:10.186640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:10.190166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:10.191024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.191305 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.191629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] PATH_INFO: `/v3/users/060efd8407b3485eb67d4651006fc184` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.192869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] RBAC: Authorizing `identity:delete_user(user_id=060efd8407b3485eb67d4651006fc184)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:10.196031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:10.198454 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:10.200036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:10.201048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:10.210540 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1230/2488] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:10 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:10.250573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '060efd8407b3485eb67d4651006fc184'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.258706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '060efd8407b3485eb67d4651006fc184'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.270954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '060efd8407b3485eb67d4651006fc184'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.284157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '060efd8407b3485eb67d4651006fc184'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.284837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '060efd8407b3485eb67d4651006fc184'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.290853 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1259/2489] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:10 2022] DELETE /identity/v3/users/060efd8407b3485eb67d4651006fc184 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:10.469952 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:10.482713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5720ebfc-6dd2-45c1-98c7-5171ca22a747 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:10.491579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:10.493374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:10.536470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:10.575795 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e57860-b771-4c66-9c68-a82cb544821e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:10.578935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:10.579795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.580074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.580417 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] PATH_INFO: `/v3/projects/7eb330d203414229afb3299a84a1adf2` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.581654 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7eb330d203414229afb3299a84a1adf2)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:10.582634 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:10.583652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.583936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.584283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] PATH_INFO: `/v3/users/b94f793f6ea84e039a144e2fee3de2ce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.584825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:10.585706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b94f793f6ea84e039a144e2fee3de2ce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:10.588082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:10.652420 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b94f793f6ea84e039a144e2fee3de2ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.659109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7eb330d203414229afb3299a84a1adf2', 'request_id': 'req-d78c71d8-1f20-456e-9d09-4648000c4e98'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.661835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b94f793f6ea84e039a144e2fee3de2ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.665607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7eb330d203414229afb3299a84a1adf2', 'request_id': 'req-d78c71d8-1f20-456e-9d09-4648000c4e98'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.670819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b94f793f6ea84e039a144e2fee3de2ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.673597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7eb330d203414229afb3299a84a1adf2', 'request_id': 'req-d78c71d8-1f20-456e-9d09-4648000c4e98'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.683350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b94f793f6ea84e039a144e2fee3de2ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.684015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-9915807a-53b0-4776-92a3-bb366808075f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b94f793f6ea84e039a144e2fee3de2ce'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.686092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] The token cache is being invalidate because project 7eb330d203414229afb3299a84a1adf2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:10.686380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.687156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d78c71d8-1f20-456e-9d09-4648000c4e98 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:10.688722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1231/2490] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:10 2022] DELETE /identity/v3/projects/7eb330d203414229afb3299a84a1adf2 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:10.690421 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1260/2491] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:10 2022] DELETE /identity/v3/users/b94f793f6ea84e039a144e2fee3de2ce => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:10.693891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870426a-5fd2-45a4-a675-571d4c9da708 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.694182 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870426a-5fd2-45a4-a675-571d4c9da708 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.694459 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f870426a-5fd2-45a4-a675-571d4c9da708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.695011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8f74-0618-4418-9d1b-f10f4e4d942d None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.695304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8f74-0618-4418-9d1b-f10f4e4d942d None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.695609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0c8f74-0618-4418-9d1b-f10f4e4d942d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.701282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:10.715127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f870426a-5fd2-45a4-a675-571d4c9da708 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:10.715318 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ee0c8f74-0618-4418-9d1b-f10f4e4d942d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:10.716345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f870426a-5fd2-45a4-a675-571d4c9da708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:10.716849 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ee0c8f74-0618-4418-9d1b-f10f4e4d942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:10.779024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1232/2492] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:10.779877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1261/2493] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:10.786574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5fb0-4b5b-426f-9e00-74e2353dd52f None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.786861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5fb0-4b5b-426f-9e00-74e2353dd52f None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.787138 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fa5fb0-4b5b-426f-9e00-74e2353dd52f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.789272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8f74-0618-4418-9d1b-f10f4e4d942d None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:10.790716 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ee0c8f74-0618-4418-9d1b-f10f4e4d942d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:10.805881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-e7fa5fb0-4b5b-426f-9e00-74e2353dd52f None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:10.807149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e7fa5fb0-4b5b-426f-9e00-74e2353dd52f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:10.815011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1233/2494] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:10.819479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa5fb0-4b5b-426f-9e00-74e2353dd52f None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:10.828480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fa5fb0-4b5b-426f-9e00-74e2353dd52f None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:10.833876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:10.834490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.834773 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.835407 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.835763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:10.836075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:10.837824 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:10.849006 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee0c8f74-0618-4418-9d1b-f10f4e4d942d None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:10.850071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1234/2495] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:43:10.853228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4891d6-61a0-4b6f-ab48-fc076df084a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:10.854144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4891d6-61a0-4b6f-ab48-fc076df084a6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.854499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4891d6-61a0-4b6f-ab48-fc076df084a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.854613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:10.854912 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb4891d6-61a0-4b6f-ab48-fc076df084a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.864947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc824270-d93e-4f44-b755-db1a5291438a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:10.865925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4891d6-61a0-4b6f-ab48-fc076df084a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:10.867407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb4891d6-61a0-4b6f-ab48-fc076df084a6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:10.870217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174766c-22ae-4bdc-a591-6b412b139d23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:10.870926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174766c-22ae-4bdc-a591-6b412b139d23 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.871219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174766c-22ae-4bdc-a591-6b412b139d23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.871491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8174766c-22ae-4bdc-a591-6b412b139d23 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.872213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174766c-22ae-4bdc-a591-6b412b139d23 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:10.874184 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8174766c-22ae-4bdc-a591-6b412b139d23 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:10.877894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1262/2496] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:10.904895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1235/2497] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:10 2022] POST /identity/v3/projects => generated 375 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:10.909327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4891d6-61a0-4b6f-ab48-fc076df084a6 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:10.919762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb4891d6-61a0-4b6f-ab48-fc076df084a6 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:10.978165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960cc80-6555-4ecc-92cf-a0e563499de8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:10.978835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cc80-6555-4ecc-92cf-a0e563499de8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:10.979111 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cc80-6555-4ecc-92cf-a0e563499de8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:10.979379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a960cc80-6555-4ecc-92cf-a0e563499de8 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:10.980060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960cc80-6555-4ecc-92cf-a0e563499de8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:10.981999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a960cc80-6555-4ecc-92cf-a0e563499de8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.008852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1263/2498] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:10 2022] POST /identity/v3/users => generated 288 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:11.010343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174766c-22ae-4bdc-a591-6b412b139d23 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:11.022286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8174766c-22ae-4bdc-a591-6b412b139d23 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:11.027403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d9cf6-ddf1-404b-a5ac-44a09fa40751 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:11.028068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9cf6-ddf1-404b-a5ac-44a09fa40751 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.028355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9cf6-ddf1-404b-a5ac-44a09fa40751 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.028632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8d9cf6-ddf1-404b-a5ac-44a09fa40751 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.029357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d9cf6-ddf1-404b-a5ac-44a09fa40751 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:11.030991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8d9cf6-ddf1-404b-a5ac-44a09fa40751 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.042601 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1236/2499] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:11.046675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960cc80-6555-4ecc-92cf-a0e563499de8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:11.057479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a960cc80-6555-4ecc-92cf-a0e563499de8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:11.062104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1904b639-9906-4ac9-8fb9-e97b2ac1c039 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:11.062755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904b639-9906-4ac9-8fb9-e97b2ac1c039 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.063034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904b639-9906-4ac9-8fb9-e97b2ac1c039 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.063309 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1904b639-9906-4ac9-8fb9-e97b2ac1c039 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.064034 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904b639-9906-4ac9-8fb9-e97b2ac1c039 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:11.065790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1904b639-9906-4ac9-8fb9-e97b2ac1c039 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.075846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1264/2500] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:11.080098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d9cf6-ddf1-404b-a5ac-44a09fa40751 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:11.090299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8d9cf6-ddf1-404b-a5ac-44a09fa40751 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:11.094958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:11.095892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.096177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.096635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] PATH_INFO: `/v3/projects/c20f2430f6164d17976a95e42adea91f/users/ec36dfc485b042a290141115a465eac4/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.101324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:11.115072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=c20f2430f6164d17976a95e42adea91f, user_id=ec36dfc485b042a290141115a465eac4, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:11.118105 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.132520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1237/2501] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:11 2022] PUT /identity/v3/projects/c20f2430f6164d17976a95e42adea91f/users/ec36dfc485b042a290141115a465eac4/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:11.143279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97377957-f032-4b9b-a5f5-b9607c1f79f2 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.143566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97377957-f032-4b9b-a5f5-b9607c1f79f2 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.143842 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97377957-f032-4b9b-a5f5-b9607c1f79f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.173260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-97377957-f032-4b9b-a5f5-b9607c1f79f2 None None] MFA Rules not processed for user `ec36dfc485b042a290141115a465eac4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:11.176765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-97377957-f032-4b9b-a5f5-b9607c1f79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:11.188768 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:11.190563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:11.190723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:11.252085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1265/2502] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:11.263038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97377957-f032-4b9b-a5f5-b9607c1f79f2 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:11.264510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-97377957-f032-4b9b-a5f5-b9607c1f79f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:11.273931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f581a4a7-ce27-4edf-a9ca-560cd51725ed admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:11.278873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:11.279728 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.280003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.280305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] PATH_INFO: `/v3/projects/161d145efa184875a1b5064ad700d4d7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.281551 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=161d145efa184875a1b5064ad700d4d7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:11.283422 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.331680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '161d145efa184875a1b5064ad700d4d7', 'request_id': 'req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.337254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '161d145efa184875a1b5064ad700d4d7', 'request_id': 'req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.340626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97377957-f032-4b9b-a5f5-b9607c1f79f2 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:11.344858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '161d145efa184875a1b5064ad700d4d7', 'request_id': 'req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.355858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] The token cache is being invalidate because project 161d145efa184875a1b5064ad700d4d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:11.356144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.356786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.358496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1238/2503] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:11 2022] DELETE /identity/v3/projects/161d145efa184875a1b5064ad700d4d7 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:11.362282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:11.364305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:11.408091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:11.408739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.409018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.409287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.411299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:11.437261 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d3a6cc-fae4-4b7a-86ad-b6010ef838eb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:11.442532 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:11.443264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.443583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.443888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] PATH_INFO: `/v3/users/71aa1799d36e47d58267680007db70aa` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.445120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=71aa1799d36e47d58267680007db70aa)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:11.447074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.462438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:11.464281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:INSERT=2,keystone:DELETE=8 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:11.476974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:11.479254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.490144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1266/2504] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:11 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:11.499828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '71aa1799d36e47d58267680007db70aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.514208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '71aa1799d36e47d58267680007db70aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.520762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '71aa1799d36e47d58267680007db70aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.535017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '71aa1799d36e47d58267680007db70aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.536260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '71aa1799d36e47d58267680007db70aa'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.545011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1239/2505] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:11 2022] DELETE /identity/v3/users/71aa1799d36e47d58267680007db70aa => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:11.748104 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:11.749906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:11.767103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128cfb56-99a2-4655-b0e4-44efbe506a07 service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:11.844734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:11.846492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:11.854396 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:11.855435 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.856112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.856638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] PATH_INFO: `/v3/users/ec36dfc485b042a290141115a465eac4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.859052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec36dfc485b042a290141115a465eac4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:11.870017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.929564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6c18f4-13d6-4b71-9c37-b576f27d6df4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:11.934785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:11.935958 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.936401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.936989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] PATH_INFO: `/v3/projects/99e771f887bb4a489da3c1f6c429b2b0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.938263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec36dfc485b042a290141115a465eac4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.938788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] RBAC: Authorizing `identity:delete_project(project_id=99e771f887bb4a489da3c1f6c429b2b0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:11.942558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:11.947703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec36dfc485b042a290141115a465eac4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.957180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec36dfc485b042a290141115a465eac4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.970005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec36dfc485b042a290141115a465eac4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.970694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cfcb804-7dbe-4957-bb11-e80b61e0d28c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec36dfc485b042a290141115a465eac4'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:11.977744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1267/2506] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:11 2022] DELETE /identity/v3/users/ec36dfc485b042a290141115a465eac4 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:11.982126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfc434-3211-4181-894f-3d2a84f7ad54 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:11.982418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfc434-3211-4181-894f-3d2a84f7ad54 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:11.982719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62bfc434-3211-4181-894f-3d2a84f7ad54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:11.996823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '99e771f887bb4a489da3c1f6c429b2b0', 'request_id': 'req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.000043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-62bfc434-3211-4181-894f-3d2a84f7ad54 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:12.001374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-62bfc434-3211-4181-894f-3d2a84f7ad54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.003392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '99e771f887bb4a489da3c1f6c429b2b0', 'request_id': 'req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.012270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '99e771f887bb4a489da3c1f6c429b2b0', 'request_id': 'req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.024853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] The token cache is being invalidate because project 99e771f887bb4a489da3c1f6c429b2b0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:12.025139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.025775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-085f219c-05ec-4c9a-aa41-cacb24cc7e2f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.027571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1240/2507] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:11 2022] DELETE /identity/v3/projects/99e771f887bb4a489da3c1f6c429b2b0 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:12.033435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc95f-2347-44fa-ac4c-3dbcfc47bc5a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.033784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc95f-2347-44fa-ac4c-3dbcfc47bc5a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.034151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368bc95f-2347-44fa-ac4c-3dbcfc47bc5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.053003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-368bc95f-2347-44fa-ac4c-3dbcfc47bc5a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:12.054260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-368bc95f-2347-44fa-ac4c-3dbcfc47bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.061408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1268/2508] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:12.062563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1241/2509] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:12.070846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a4b1-0152-4619-9609-583a47d0879a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.071184 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a4b1-0152-4619-9609-583a47d0879a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.071383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bc95f-2347-44fa-ac4c-3dbcfc47bc5a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.071498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7545a4b1-0152-4619-9609-583a47d0879a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.072786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-368bc95f-2347-44fa-ac4c-3dbcfc47bc5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.092736 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7545a4b1-0152-4619-9609-583a47d0879a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:12.093948 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7545a4b1-0152-4619-9609-583a47d0879a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.095435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:12.104026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1269/2510] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:12.107629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545a4b1-0152-4619-9609-583a47d0879a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.112040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:12.120334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7545a4b1-0152-4619-9609-583a47d0879a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.126049 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.126699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.126971 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.127239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.127954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:12.128248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.129909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.141689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1270/2511] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:43:12.146486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368bc95f-2347-44fa-ac4c-3dbcfc47bc5a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.147045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.150676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489c9ec-b862-42a3-9712-1613635452a4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.151493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c9ec-b862-42a3-9712-1613635452a4 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.152030 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c9ec-b862-42a3-9712-1613635452a4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.152430 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3489c9ec-b862-42a3-9712-1613635452a4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.157788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85605e52-6948-4851-998e-63303f7f3e59 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.162790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489c9ec-b862-42a3-9712-1613635452a4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.164119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd226dfe-83b5-44b3-80bc-a3f5f7da424e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.164245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3489c9ec-b862-42a3-9712-1613635452a4 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.164793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226dfe-83b5-44b3-80bc-a3f5f7da424e admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.165068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226dfe-83b5-44b3-80bc-a3f5f7da424e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.165341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd226dfe-83b5-44b3-80bc-a3f5f7da424e admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.166060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd226dfe-83b5-44b3-80bc-a3f5f7da424e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.167933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd226dfe-83b5-44b3-80bc-a3f5f7da424e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.175267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1242/2512] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:12.195018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1271/2513] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/projects => generated 359 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:12.199101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489c9ec-b862-42a3-9712-1613635452a4 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.209333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3489c9ec-b862-42a3-9712-1613635452a4 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.273490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7988be-71f9-473d-a33c-79217c6f1246 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.274158 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7988be-71f9-473d-a33c-79217c6f1246 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.274440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7988be-71f9-473d-a33c-79217c6f1246 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.274714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e7988be-71f9-473d-a33c-79217c6f1246 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.275403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7988be-71f9-473d-a33c-79217c6f1246 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.277866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e7988be-71f9-473d-a33c-79217c6f1246 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.299173 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1243/2514] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/users => generated 280 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:12.303850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd226dfe-83b5-44b3-80bc-a3f5f7da424e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.314009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd226dfe-83b5-44b3-80bc-a3f5f7da424e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.318786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6a183-e0fe-4f64-bccd-75bb87271a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.319432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6a183-e0fe-4f64-bccd-75bb87271a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.319713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6a183-e0fe-4f64-bccd-75bb87271a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.319965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88b6a183-e0fe-4f64-bccd-75bb87271a09 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.320692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6a183-e0fe-4f64-bccd-75bb87271a09 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.322293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88b6a183-e0fe-4f64-bccd-75bb87271a09 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.333829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1272/2515] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:12.337516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7988be-71f9-473d-a33c-79217c6f1246 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.348371 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e7988be-71f9-473d-a33c-79217c6f1246 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.353125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c4f3668-3429-45ae-8c67-697b942f8644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.353808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3668-3429-45ae-8c67-697b942f8644 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.354089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3668-3429-45ae-8c67-697b942f8644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.354364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c4f3668-3429-45ae-8c67-697b942f8644 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.355089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f3668-3429-45ae-8c67-697b942f8644 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.356989 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c4f3668-3429-45ae-8c67-697b942f8644 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.367965 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1244/2516] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:12.372078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6a183-e0fe-4f64-bccd-75bb87271a09 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.383007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88b6a183-e0fe-4f64-bccd-75bb87271a09 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.387792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.388660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.389081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.389357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] PATH_INFO: `/v3/projects/a1b05f7e7f1448a1be263ec902f2c0a8/users/50e37cc77a444be08b59d084f0da7a5e/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.405369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a1b05f7e7f1448a1be263ec902f2c0a8, user_id=50e37cc77a444be08b59d084f0da7a5e, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.408118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.425375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1273/2517] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:12 2022] PUT /identity/v3/projects/a1b05f7e7f1448a1be263ec902f2c0a8/users/50e37cc77a444be08b59d084f0da7a5e/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:12.438353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe2f2e-e030-43aa-998e-28122dcdd34d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.438646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe2f2e-e030-43aa-998e-28122dcdd34d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.438927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cfe2f2e-e030-43aa-998e-28122dcdd34d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.467885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5cfe2f2e-e030-43aa-998e-28122dcdd34d None None] MFA Rules not processed for user `50e37cc77a444be08b59d084f0da7a5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:12.469197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5cfe2f2e-e030-43aa-998e-28122dcdd34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.484449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.486193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.539178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1245/2518] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:12.565771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9a48b2f-2b54-4502-86b2-25a41e78a093 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.571379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.571579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe2f2e-e030-43aa-998e-28122dcdd34d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.572230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.572506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.572777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] PATH_INFO: `/v3/projects/c20f2430f6164d17976a95e42adea91f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.573008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5cfe2f2e-e030-43aa-998e-28122dcdd34d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.573992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] RBAC: Authorizing `identity:delete_project(project_id=c20f2430f6164d17976a95e42adea91f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.575893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.605612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:12.623731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c20f2430f6164d17976a95e42adea91f', 'request_id': 'req-6e9f7bdd-b781-4469-b20f-9140981b65cf'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.630300 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c20f2430f6164d17976a95e42adea91f', 'request_id': 'req-6e9f7bdd-b781-4469-b20f-9140981b65cf'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.636251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cfe2f2e-e030-43aa-998e-28122dcdd34d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.638861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c20f2430f6164d17976a95e42adea91f', 'request_id': 'req-6e9f7bdd-b781-4469-b20f-9140981b65cf'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.649985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] The token cache is being invalidate because project c20f2430f6164d17976a95e42adea91f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:12.650384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.651067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6e9f7bdd-b781-4469-b20f-9140981b65cf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.652873 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1274/2519] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:12 2022] DELETE /identity/v3/projects/c20f2430f6164d17976a95e42adea91f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:12.657875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c5b3-3044-4f6a-8121-c884c76c4a93 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.658490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c5b3-3044-4f6a-8121-c884c76c4a93 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.658765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c66c5b3-3044-4f6a-8121-c884c76c4a93 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.677141 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7c66c5b3-3044-4f6a-8121-c884c76c4a93 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:12.678380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c66c5b3-3044-4f6a-8121-c884c76c4a93 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.686796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.687451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.687740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.688017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.689838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.695942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:12.741031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1275/2520] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:12.748779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d508-4042-4410-8988-1cc3dc585021 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.749061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d508-4042-4410-8988-1cc3dc585021 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.749336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e10d508-4042-4410-8988-1cc3dc585021 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.751225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.752682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.763909 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1246/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:12 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:12.769147 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7e10d508-4042-4410-8988-1cc3dc585021 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:12.771384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7e10d508-4042-4410-8988-1cc3dc585021 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.779139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.780311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1276/2522] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:12.780625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.784330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10d508-4042-4410-8988-1cc3dc585021 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.793497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e10d508-4042-4410-8988-1cc3dc585021 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.794201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4d14f23-9209-40a0-be9f-a67a145e456f service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.798067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.798678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.798792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.798951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.799218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.799531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.799814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.799919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:12.800089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] PATH_INFO: `/v3/users/50e37cc77a444be08b59d084f0da7a5e` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.800207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.802041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=50e37cc77a444be08b59d084f0da7a5e)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.802346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.804002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.813794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1277/2523] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:43:12.818134 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.827501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57dd95c0-5e43-4f46-b885-e4cf9284536c admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.833482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9be23-db45-4820-b97a-9d18100e8194 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:12.834303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9be23-db45-4820-b97a-9d18100e8194 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.834607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9be23-db45-4820-b97a-9d18100e8194 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.834860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fa9be23-db45-4820-b97a-9d18100e8194 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.835589 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9be23-db45-4820-b97a-9d18100e8194 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:12.837587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fa9be23-db45-4820-b97a-9d18100e8194 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:12.851733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '50e37cc77a444be08b59d084f0da7a5e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.863096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1278/2524] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/projects => generated 401 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:12.866231 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '50e37cc77a444be08b59d084f0da7a5e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.867985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9be23-db45-4820-b97a-9d18100e8194 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.873302 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '50e37cc77a444be08b59d084f0da7a5e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.881520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '50e37cc77a444be08b59d084f0da7a5e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.882142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b7d80681-2c97-4bfe-8fd4-4f279ce70a37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '50e37cc77a444be08b59d084f0da7a5e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:12.888254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1247/2525] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:12 2022] DELETE /identity/v3/users/50e37cc77a444be08b59d084f0da7a5e => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:12.893498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488675d-4f9f-49d5-a6db-dccd29ad3121 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:12.893792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488675d-4f9f-49d5-a6db-dccd29ad3121 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:12.894071 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9488675d-4f9f-49d5-a6db-dccd29ad3121 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:12.914075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9488675d-4f9f-49d5-a6db-dccd29ad3121 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:12.915289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9488675d-4f9f-49d5-a6db-dccd29ad3121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:12.920383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:12.931362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fa9be23-db45-4820-b97a-9d18100e8194 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:12.980839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1248/2526] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:12.992466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488675d-4f9f-49d5-a6db-dccd29ad3121 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:12.993946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9488675d-4f9f-49d5-a6db-dccd29ad3121 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:13.003099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:13.003774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:13.004079 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:13.004354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:13.005190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:13.007254 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:13.033288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1279/2527] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:12 2022] POST /identity/v3/users => generated 301 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:13.034778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:13.037937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:13.051595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a11c00-2716-47a0-a86b-83a3a0f7a75b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:13.056494 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3305a-32b2-4b10-a5a0-4fb02a15c1a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:13.057155 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3305a-32b2-4b10-a5a0-4fb02a15c1a3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:13.057464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3305a-32b2-4b10-a5a0-4fb02a15c1a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:13.058192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b3305a-32b2-4b10-a5a0-4fb02a15c1a3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:13.059106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3305a-32b2-4b10-a5a0-4fb02a15c1a3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:13.060707 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b3305a-32b2-4b10-a5a0-4fb02a15c1a3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:13.063693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9488675d-4f9f-49d5-a6db-dccd29ad3121 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:13.068094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59944da3-d29a-4104-85e4-32d920344173 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:13.068478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944da3-d29a-4104-85e4-32d920344173 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:13.068760 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944da3-d29a-4104-85e4-32d920344173 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:13.069027 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59944da3-d29a-4104-85e4-32d920344173 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:13.072462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1280/2528] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:43:13.076269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3305a-32b2-4b10-a5a0-4fb02a15c1a3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:13.080188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59944da3-d29a-4104-85e4-32d920344173 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:13.081689 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59944da3-d29a-4104-85e4-32d920344173 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:13.089085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b3305a-32b2-4b10-a5a0-4fb02a15c1a3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:13.092383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1249/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:13.100829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9a210b5-123c-48bc-8532-6c3f0f2b6eb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:13.101800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a210b5-123c-48bc-8532-6c3f0f2b6eb9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:13.102268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a210b5-123c-48bc-8532-6c3f0f2b6eb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:13.102583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9a210b5-123c-48bc-8532-6c3f0f2b6eb9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:13.103358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a210b5-123c-48bc-8532-6c3f0f2b6eb9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:13.104988 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9a210b5-123c-48bc-8532-6c3f0f2b6eb9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:13.106739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:13.120070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1281/2530] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:13 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:43:13.124040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59944da3-d29a-4104-85e4-32d920344173 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:13.135303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59944da3-d29a-4104-85e4-32d920344173 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:13.140839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cb34-4cfa-47a6-9a06-e5b2e3828538 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:13.142254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cb34-4cfa-47a6-9a06-e5b2e3828538 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:13.142646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cb34-4cfa-47a6-9a06-e5b2e3828538 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:13.142942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f090cb34-4cfa-47a6-9a06-e5b2e3828538 admin admin] PATH_INFO: `/v3/projects/9465ef43d02144ab94ba6fc59a8063c9/users/9d9ec73fd10b43ec9e60e55f45084bd0/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:13.159956 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090cb34-4cfa-47a6-9a06-e5b2e3828538 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9465ef43d02144ab94ba6fc59a8063c9, user_id=9d9ec73fd10b43ec9e60e55f45084bd0, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:13.163236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f090cb34-4cfa-47a6-9a06-e5b2e3828538 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:13.180061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1250/2531] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:13 2022] PUT /identity/v3/projects/9465ef43d02144ab94ba6fc59a8063c9/users/9d9ec73fd10b43ec9e60e55f45084bd0/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:13.185770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599f8e1-526b-4357-983f-b29fb36b9544 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:13.186065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599f8e1-526b-4357-983f-b29fb36b9544 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:13.186395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f599f8e1-526b-4357-983f-b29fb36b9544 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:13.211925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f599f8e1-526b-4357-983f-b29fb36b9544 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:13.213264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f599f8e1-526b-4357-983f-b29fb36b9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:13.317389 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1282/2532] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:13.324227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cb34-4cfa-47a6-9a06-e5b2e3828538 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:13.389269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f090cb34-4cfa-47a6-9a06-e5b2e3828538 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:13.393564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdc820-ff05-4112-81ad-1ecafab921f8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:13.394258 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdc820-ff05-4112-81ad-1ecafab921f8 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:13.395200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdc820-ff05-4112-81ad-1ecafab921f8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:13.396169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdc820-ff05-4112-81ad-1ecafab921f8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:13.406568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdc820-ff05-4112-81ad-1ecafab921f8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:13.408048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdc820-ff05-4112-81ad-1ecafab921f8 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:13.412179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599f8e1-526b-4357-983f-b29fb36b9544 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:13.413622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f599f8e1-526b-4357-983f-b29fb36b9544 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:13.424645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1251/2533] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:13.427921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f599f8e1-526b-4357-983f-b29fb36b9544 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:13.432547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:13.433401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:13.434274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:13.434274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] PATH_INFO: `/v3/projects/a1b05f7e7f1448a1be263ec902f2c0a8` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:13.435185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a1b05f7e7f1448a1be263ec902f2c0a8)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:13.437096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:13.492450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a1b05f7e7f1448a1be263ec902f2c0a8', 'request_id': 'req-56c71e26-1167-4302-b0e0-a5b84aa2bd86'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:13.498983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a1b05f7e7f1448a1be263ec902f2c0a8', 'request_id': 'req-56c71e26-1167-4302-b0e0-a5b84aa2bd86'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:13.507515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a1b05f7e7f1448a1be263ec902f2c0a8', 'request_id': 'req-56c71e26-1167-4302-b0e0-a5b84aa2bd86'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:13.518604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] The token cache is being invalidate because project a1b05f7e7f1448a1be263ec902f2c0a8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:13.519002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:13.520506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:13.522424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1283/2534] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:13 2022] DELETE /identity/v3/projects/a1b05f7e7f1448a1be263ec902f2c0a8 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:14.097506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ac66-053b-4921-ac9f-4e3b59d0a308 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:14.097867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ac66-053b-4921-ac9f-4e3b59d0a308 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:14.098107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5da2ac66-053b-4921-ac9f-4e3b59d0a308 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:14.126550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5da2ac66-053b-4921-ac9f-4e3b59d0a308 None None] MFA Rules not processed for user `9d9ec73fd10b43ec9e60e55f45084bd0`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:14.128037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5da2ac66-053b-4921-ac9f-4e3b59d0a308 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:14.153364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:14.200506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1252/2535] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:14 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:14.205136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:14.206587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:14.272638 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c71e26-1167-4302-b0e0-a5b84aa2bd86 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:14.277461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c09ea-4831-484b-90e5-302167aa89c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:14.278114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c09ea-4831-484b-90e5-302167aa89c6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:14.278388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c09ea-4831-484b-90e5-302167aa89c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:14.278771 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c09ea-4831-484b-90e5-302167aa89c6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:14.279455 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c09ea-4831-484b-90e5-302167aa89c6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:14.281341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de3c09ea-4831-484b-90e5-302167aa89c6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:14.306189 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1284/2536] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:14 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:14.309966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ac66-053b-4921-ac9f-4e3b59d0a308 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:14.322121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5da2ac66-053b-4921-ac9f-4e3b59d0a308 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:14.381842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5e08f-1e08-44a1-852c-11bbf427938c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:14.382632 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5e08f-1e08-44a1-852c-11bbf427938c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:14.382912 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5e08f-1e08-44a1-852c-11bbf427938c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:14.383180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e5e08f-1e08-44a1-852c-11bbf427938c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:14.383862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5e08f-1e08-44a1-852c-11bbf427938c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:14.385780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56e5e08f-1e08-44a1-852c-11bbf427938c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:14.407039 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1253/2537] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:14 2022] POST /identity/v3/users => generated 308 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:14.414766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c09ea-4831-484b-90e5-302167aa89c6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:14.422015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:14.427304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c09ea-4831-484b-90e5-302167aa89c6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:14.450472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63454f27-1c8a-4085-9ce7-62c92a70e0ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:14.451196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63454f27-1c8a-4085-9ce7-62c92a70e0ad admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:14.451626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63454f27-1c8a-4085-9ce7-62c92a70e0ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:14.451894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63454f27-1c8a-4085-9ce7-62c92a70e0ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:14.452652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63454f27-1c8a-4085-9ce7-62c92a70e0ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:14.454301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63454f27-1c8a-4085-9ce7-62c92a70e0ad admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:14.470016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1285/2538] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:14.470684 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5e08f-1e08-44a1-852c-11bbf427938c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:14.480947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e5e08f-1e08-44a1-852c-11bbf427938c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:14.486412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0641a-cf71-492d-8b14-cf0782708d79 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:14.487295 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0641a-cf71-492d-8b14-cf0782708d79 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:14.487571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0641a-cf71-492d-8b14-cf0782708d79 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:14.487847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1c0641a-cf71-492d-8b14-cf0782708d79 admin admin] PATH_INFO: `/v3/projects/19fee50afac74454bd4ea83d81ed93bc/users/098281e82cdb43a9a246962f0d29aeaf/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:14.504894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0641a-cf71-492d-8b14-cf0782708d79 admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fee50afac74454bd4ea83d81ed93bc, user_id=098281e82cdb43a9a246962f0d29aeaf, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:14.507727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1c0641a-cf71-492d-8b14-cf0782708d79 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:14.523201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1254/2539] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:14 2022] PUT /identity/v3/projects/19fee50afac74454bd4ea83d81ed93bc/users/098281e82cdb43a9a246962f0d29aeaf/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:14.527465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63454f27-1c8a-4085-9ce7-62c92a70e0ad admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:14.538371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63454f27-1c8a-4085-9ce7-62c92a70e0ad admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:14.606056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a3a1d4-b787-4a48-875f-c58d47f64ed6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:14.606719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a1d4-b787-4a48-875f-c58d47f64ed6 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:14.607001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a1d4-b787-4a48-875f-c58d47f64ed6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:14.607277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a3a1d4-b787-4a48-875f-c58d47f64ed6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:14.608040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a1d4-b787-4a48-875f-c58d47f64ed6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:14.609689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a3a1d4-b787-4a48-875f-c58d47f64ed6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:14.619788 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1286/2540] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:14 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:14.623903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0641a-cf71-492d-8b14-cf0782708d79 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:14.634550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1c0641a-cf71-492d-8b14-cf0782708d79 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:14.639023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c6f3eb-2f84-4a61-ac2d-b90f23f5a23e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:14.639883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6f3eb-2f84-4a61-ac2d-b90f23f5a23e admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:14.640161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6f3eb-2f84-4a61-ac2d-b90f23f5a23e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:14.640432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c6f3eb-2f84-4a61-ac2d-b90f23f5a23e admin admin] PATH_INFO: `/v3/projects/19fee50afac74454bd4ea83d81ed93bc/users/098281e82cdb43a9a246962f0d29aeaf/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:14.642378 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6f3eb-2f84-4a61-ac2d-b90f23f5a23e admin admin] RBAC: Authorizing `identity:create_grant(project_id=19fee50afac74454bd4ea83d81ed93bc, user_id=098281e82cdb43a9a246962f0d29aeaf, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:14.645358 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84c6f3eb-2f84-4a61-ac2d-b90f23f5a23e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:14.658211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1255/2541] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:14 2022] PUT /identity/v3/projects/19fee50afac74454bd4ea83d81ed93bc/users/098281e82cdb43a9a246962f0d29aeaf/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:15.252691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5bdf-6943-4fcf-b8c5-b221d9cf189a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:15.252985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5bdf-6943-4fcf-b8c5-b221d9cf189a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:15.253262 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee0a5bdf-6943-4fcf-b8c5-b221d9cf189a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:15.280537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ee0a5bdf-6943-4fcf-b8c5-b221d9cf189a None None] MFA Rules not processed for user `098281e82cdb43a9a246962f0d29aeaf`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:15.281890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ee0a5bdf-6943-4fcf-b8c5-b221d9cf189a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:15.357256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1287/2542] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:15 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:16.669229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3118-74fd-4577-af8d-ce0cf918f372 None None] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:16.669769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3118-74fd-4577-af8d-ce0cf918f372 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:16.669867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400e3118-74fd-4577-af8d-ce0cf918f372 None None] PATH_INFO: `/` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:16.671139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1256/2543] 10.222.0.20 () {54 vars in 921 bytes} [Tue Jul 12 08:43:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 12 08:43:16.684846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0760d-24e4-4535-835c-faa742030169 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:16.685265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0760d-24e4-4535-835c-faa742030169 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:16.685583 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ef0760d-24e4-4535-835c-faa742030169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:16.703656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-8ef0760d-24e4-4535-835c-faa742030169 None None] MFA Rules not processed for user `94eb335ec8004aa493080367f844d730`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:16.704840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8ef0760d-24e4-4535-835c-faa742030169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:16.758067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e3118-74fd-4577-af8d-ce0cf918f372 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:16.774951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1288/2544] 10.222.0.20 () {58 vars in 1018 bytes} [Tue Jul 12 08:43:16 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:16.787510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0760d-24e4-4535-835c-faa742030169 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:16.788967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8ef0760d-24e4-4535-835c-faa742030169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:16.801857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ef0760d-24e4-4535-835c-faa742030169 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:16.807264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5758f-e9e8-4e40-a10f-ff176a3170b2 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:16.807894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5758f-e9e8-4e40-a10f-ff176a3170b2 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:16.808209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5758f-e9e8-4e40-a10f-ff176a3170b2 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:16.808457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe5758f-e9e8-4e40-a10f-ff176a3170b2 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:16.817040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5758f-e9e8-4e40-a10f-ff176a3170b2 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:16.818654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebe5758f-e9e8-4e40-a10f-ff176a3170b2 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:16.823014 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:16.825474 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400e3118-74fd-4577-af8d-ce0cf918f372 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:16.829039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1289/2545] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:16 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:16.829994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:16.830851 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:16.831130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:16.831406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] PATH_INFO: `/v3/users/9d9ec73fd10b43ec9e60e55f45084bd0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:16.833753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d9ec73fd10b43ec9e60e55f45084bd0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:16.835667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:16.852042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:16.881757 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d9ec73fd10b43ec9e60e55f45084bd0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:16.893202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d9ec73fd10b43ec9e60e55f45084bd0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:16.899937 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d9ec73fd10b43ec9e60e55f45084bd0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:16.907168 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d9ec73fd10b43ec9e60e55f45084bd0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:16.907827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d9ec73fd10b43ec9e60e55f45084bd0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:16.914925 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1257/2546] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:16 2022] DELETE /identity/v3/users/9d9ec73fd10b43ec9e60e55f45084bd0 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:17.089590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5758f-e9e8-4e40-a10f-ff176a3170b2 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:17.102829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebe5758f-e9e8-4e40-a10f-ff176a3170b2 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:17.167284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:17.168408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:17.168596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:17.168935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] PATH_INFO: `/v3/projects/9465ef43d02144ab94ba6fc59a8063c9` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:17.170149 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9465ef43d02144ab94ba6fc59a8063c9)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:17.172039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:17.225004 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9465ef43d02144ab94ba6fc59a8063c9', 'request_id': 'req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.231274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9465ef43d02144ab94ba6fc59a8063c9', 'request_id': 'req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.241074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9465ef43d02144ab94ba6fc59a8063c9', 'request_id': 'req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.253224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] The token cache is being invalidate because project 9465ef43d02144ab94ba6fc59a8063c9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:17.253642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.254934 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.256622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1290/2547] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:17 2022] DELETE /identity/v3/projects/9465ef43d02144ab94ba6fc59a8063c9 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:17.260740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:17.262354 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:17.276021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343b8729-3508-42c6-ad1f-cf092933d2ff admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:17.336967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:17.337943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:17.338234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:17.338511 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] PATH_INFO: `/v3/users/098281e82cdb43a9a246962f0d29aeaf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:17.339725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] RBAC: Authorizing `identity:delete_user(user_id=098281e82cdb43a9a246962f0d29aeaf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:17.341669 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:17.389842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '098281e82cdb43a9a246962f0d29aeaf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.403740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '098281e82cdb43a9a246962f0d29aeaf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.410862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '098281e82cdb43a9a246962f0d29aeaf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.422339 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '098281e82cdb43a9a246962f0d29aeaf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.423054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '098281e82cdb43a9a246962f0d29aeaf'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.431086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1258/2548] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:17 2022] DELETE /identity/v3/users/098281e82cdb43a9a246962f0d29aeaf => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:17.460958 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:17.462772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:17.540680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cacda12-58ff-4f6a-bf6a-e55d89cbd834 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:17.589113 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:17.597773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d64efcd-9fee-4dd1-baf6-0ee701ef8097 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:17.598612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64efcd-9fee-4dd1-baf6-0ee701ef8097 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:17.599017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64efcd-9fee-4dd1-baf6-0ee701ef8097 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:17.600013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d64efcd-9fee-4dd1-baf6-0ee701ef8097 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:17.603368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8d64efcd-9fee-4dd1-baf6-0ee701ef8097 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:17.620432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:17.622352 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:17.646729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=19,keystone:SELECT=79,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:17.692931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64efcd-9fee-4dd1-baf6-0ee701ef8097 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:17.694486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d64efcd-9fee-4dd1-baf6-0ee701ef8097 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:17.703801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1291/2549] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:17 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:17.717064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4c9d3b9-0ac4-44e6-9887-3d7174e8c66b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:17.721691 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:17.723087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:17.723997 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:17.724262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] PATH_INFO: `/v3/projects/19fee50afac74454bd4ea83d81ed93bc` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:17.725504 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] RBAC: Authorizing `identity:delete_project(project_id=19fee50afac74454bd4ea83d81ed93bc)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:17.727443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:17.778451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '19fee50afac74454bd4ea83d81ed93bc', 'request_id': 'req-9a600f0f-7731-4b06-9da7-feb3ab461c5f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.784187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '19fee50afac74454bd4ea83d81ed93bc', 'request_id': 'req-9a600f0f-7731-4b06-9da7-feb3ab461c5f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.792855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '19fee50afac74454bd4ea83d81ed93bc', 'request_id': 'req-9a600f0f-7731-4b06-9da7-feb3ab461c5f'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.805468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] The token cache is being invalidate because project 19fee50afac74454bd4ea83d81ed93bc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:17.805750 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.806405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-9a600f0f-7731-4b06-9da7-feb3ab461c5f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:17.808192 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1259/2550] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:17 2022] DELETE /identity/v3/projects/19fee50afac74454bd4ea83d81ed93bc => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:17.813331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ba9b-1d14-4cc7-afcc-286703941cb6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:17.813666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ba9b-1d14-4cc7-afcc-286703941cb6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:17.813938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ec7ba9b-1d14-4cc7-afcc-286703941cb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:17.835479 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-0ec7ba9b-1d14-4cc7-afcc-286703941cb6 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:17.836753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0ec7ba9b-1d14-4cc7-afcc-286703941cb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:17.902696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1292/2551] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:17.910830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8b9b-6389-45ca-8aac-79921478cc34 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:17.911257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8b9b-6389-45ca-8aac-79921478cc34 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:17.911733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f8b9b-6389-45ca-8aac-79921478cc34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:17.930391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cb3f8b9b-6389-45ca-8aac-79921478cc34 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:17.931621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cb3f8b9b-6389-45ca-8aac-79921478cc34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:17.940406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1260/2552] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:17.961264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ba9b-1d14-4cc7-afcc-286703941cb6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:17.972093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ec7ba9b-1d14-4cc7-afcc-286703941cb6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:17.977595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:17.978276 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:17.978547 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:17.978820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:17.979551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:17.979860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:17.981499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:17.994191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1293/2553] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:43:17.998487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8b9b-6389-45ca-8aac-79921478cc34 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.008133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f8b9b-6389-45ca-8aac-79921478cc34 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.012836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd012c-1c8b-45ef-8ca1-47fee3383b30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.013539 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd012c-1c8b-45ef-8ca1-47fee3383b30 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.013812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd012c-1c8b-45ef-8ca1-47fee3383b30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.014083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5cd012c-1c8b-45ef-8ca1-47fee3383b30 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.014814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd012c-1c8b-45ef-8ca1-47fee3383b30 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.016742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5cd012c-1c8b-45ef-8ca1-47fee3383b30 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.047887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1261/2554] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:17 2022] POST /identity/v3/projects => generated 373 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:18.049298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.060452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d3331f4-e981-4f8d-b290-0aeeaa4f9c21 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.118773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc0da5-908a-47b0-ad97-070cebfa18e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.119497 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc0da5-908a-47b0-ad97-070cebfa18e3 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.119775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc0da5-908a-47b0-ad97-070cebfa18e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.120043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33cc0da5-908a-47b0-ad97-070cebfa18e3 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.120781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc0da5-908a-47b0-ad97-070cebfa18e3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.122687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33cc0da5-908a-47b0-ad97-070cebfa18e3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.145731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1294/2555] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:18 2022] POST /identity/v3/users => generated 287 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:18.150220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd012c-1c8b-45ef-8ca1-47fee3383b30 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.162241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5cd012c-1c8b-45ef-8ca1-47fee3383b30 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.167017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a160980-671d-4029-95aa-0bf88c82c724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.167778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a160980-671d-4029-95aa-0bf88c82c724 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.168056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a160980-671d-4029-95aa-0bf88c82c724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.168325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a160980-671d-4029-95aa-0bf88c82c724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.169044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a160980-671d-4029-95aa-0bf88c82c724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.170673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a160980-671d-4029-95aa-0bf88c82c724 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.181811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1262/2556] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:18.185924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc0da5-908a-47b0-ad97-070cebfa18e3 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.196301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33cc0da5-908a-47b0-ad97-070cebfa18e3 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.200920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d898-f0f9-4cb7-a190-c22ad3299697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.201612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d898-f0f9-4cb7-a190-c22ad3299697 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.201893 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d898-f0f9-4cb7-a190-c22ad3299697 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.202164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d898-f0f9-4cb7-a190-c22ad3299697 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.202895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d898-f0f9-4cb7-a190-c22ad3299697 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.204482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d898-f0f9-4cb7-a190-c22ad3299697 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.215382 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1295/2557] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:18.219667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a160980-671d-4029-95aa-0bf88c82c724 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.230242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a160980-671d-4029-95aa-0bf88c82c724 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.234795 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cf9e7-f042-4545-98cc-128c67ca3ca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.235701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf9e7-f042-4545-98cc-128c67ca3ca7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.235980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf9e7-f042-4545-98cc-128c67ca3ca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.236250 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9cf9e7-f042-4545-98cc-128c67ca3ca7 admin admin] PATH_INFO: `/v3/projects/06b773ab4e4d4760af93d81435845e40/users/1dce1ffaffb44d27a40960b4cba340bc/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.253046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cf9e7-f042-4545-98cc-128c67ca3ca7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06b773ab4e4d4760af93d81435845e40, user_id=1dce1ffaffb44d27a40960b4cba340bc, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.255870 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa9cf9e7-f042-4545-98cc-128c67ca3ca7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.268235 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1263/2558] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:18 2022] PUT /identity/v3/projects/06b773ab4e4d4760af93d81435845e40/users/1dce1ffaffb44d27a40960b4cba340bc/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:18.279177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f001801-0d71-4d6a-a495-1fccd0f9dfea None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.279534 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f001801-0d71-4d6a-a495-1fccd0f9dfea None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.279871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f001801-0d71-4d6a-a495-1fccd0f9dfea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.286657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:18.312016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2f001801-0d71-4d6a-a495-1fccd0f9dfea None None] MFA Rules not processed for user `1dce1ffaffb44d27a40960b4cba340bc`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:18.313222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2f001801-0d71-4d6a-a495-1fccd0f9dfea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:18.391661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1296/2559] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:18.393781 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cf9e7-f042-4545-98cc-128c67ca3ca7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.446424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:18.469948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9cf9e7-f042-4545-98cc-128c67ca3ca7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.477325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c81e60-1cae-4691-9cb1-065ce9a8920e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.478250 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c81e60-1cae-4691-9cb1-065ce9a8920e admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.478514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c81e60-1cae-4691-9cb1-065ce9a8920e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.478779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c81e60-1cae-4691-9cb1-065ce9a8920e admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.479468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c81e60-1cae-4691-9cb1-065ce9a8920e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.481363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c81e60-1cae-4691-9cb1-065ce9a8920e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.513455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1264/2560] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:18 2022] POST /identity/v3/projects => generated 373 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:18.516968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f001801-0d71-4d6a-a495-1fccd0f9dfea None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.529137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f001801-0d71-4d6a-a495-1fccd0f9dfea None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.599816 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d28d4-b6fe-4ebb-80b4-a306da39b8f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.600402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d28d4-b6fe-4ebb-80b4-a306da39b8f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.600875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d28d4-b6fe-4ebb-80b4-a306da39b8f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.601179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e38d28d4-b6fe-4ebb-80b4-a306da39b8f7 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.601919 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d28d4-b6fe-4ebb-80b4-a306da39b8f7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.604571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e38d28d4-b6fe-4ebb-80b4-a306da39b8f7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.626089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1297/2561] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:18 2022] POST /identity/v3/users => generated 293 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:18.631177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c81e60-1cae-4691-9cb1-065ce9a8920e admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.641685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c81e60-1cae-4691-9cb1-065ce9a8920e admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.647040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ecb88-3a56-41e6-9018-626c8126341c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.647705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ecb88-3a56-41e6-9018-626c8126341c admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.647993 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ecb88-3a56-41e6-9018-626c8126341c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.648274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e1ecb88-3a56-41e6-9018-626c8126341c admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.649001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ecb88-3a56-41e6-9018-626c8126341c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.650706 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e1ecb88-3a56-41e6-9018-626c8126341c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.663099 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1265/2562] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:43:18.667405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d28d4-b6fe-4ebb-80b4-a306da39b8f7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.681033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e38d28d4-b6fe-4ebb-80b4-a306da39b8f7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.686265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245aa20c-b58b-48ad-adcc-a3911f93dda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.687220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aa20c-b58b-48ad-adcc-a3911f93dda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.687571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aa20c-b58b-48ad-adcc-a3911f93dda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.687921 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245aa20c-b58b-48ad-adcc-a3911f93dda9 admin admin] PATH_INFO: `/v3/projects/45bff6f6029546c283910ef910002b26/users/f3a731c70b974f7a9e63f682513fd198/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.705028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245aa20c-b58b-48ad-adcc-a3911f93dda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bff6f6029546c283910ef910002b26, user_id=f3a731c70b974f7a9e63f682513fd198, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.707973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245aa20c-b58b-48ad-adcc-a3911f93dda9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.725045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1298/2563] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:18 2022] PUT /identity/v3/projects/45bff6f6029546c283910ef910002b26/users/f3a731c70b974f7a9e63f682513fd198/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:18.729001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ecb88-3a56-41e6-9018-626c8126341c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.744417 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e1ecb88-3a56-41e6-9018-626c8126341c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.813018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3289d56-96d7-4837-a0a9-8ed1cc433689 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.813794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3289d56-96d7-4837-a0a9-8ed1cc433689 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.814297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3289d56-96d7-4837-a0a9-8ed1cc433689 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.814671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3289d56-96d7-4837-a0a9-8ed1cc433689 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.815473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3289d56-96d7-4837-a0a9-8ed1cc433689 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.817508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3289d56-96d7-4837-a0a9-8ed1cc433689 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.827722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1266/2564] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:18 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:18.832417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245aa20c-b58b-48ad-adcc-a3911f93dda9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.842975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245aa20c-b58b-48ad-adcc-a3911f93dda9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:18.856486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:18.858392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.858778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.859150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] PATH_INFO: `/v3/projects/45bff6f6029546c283910ef910002b26/users/f3a731c70b974f7a9e63f682513fd198/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.861315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] RBAC: Authorizing `identity:create_grant(project_id=45bff6f6029546c283910ef910002b26, user_id=f3a731c70b974f7a9e63f682513fd198, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:18.864705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:18.877630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1299/2565] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:18 2022] PUT /identity/v3/projects/45bff6f6029546c283910ef910002b26/users/f3a731c70b974f7a9e63f682513fd198/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:18.889741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966585a5-091a-44f9-8a3d-1e99361f300b None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:18.890207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966585a5-091a-44f9-8a3d-1e99361f300b None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:18.890782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-966585a5-091a-44f9-8a3d-1e99361f300b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:18.916228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:18.918149 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:18.924755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-966585a5-091a-44f9-8a3d-1e99361f300b None None] MFA Rules not processed for user `f3a731c70b974f7a9e63f682513fd198`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:18.927035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-966585a5-091a-44f9-8a3d-1e99361f300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:19.007169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:19.031032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1267/2566] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:18 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:19.042763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966585a5-091a-44f9-8a3d-1e99361f300b None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:19.047209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-966585a5-091a-44f9-8a3d-1e99361f300b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:19.070577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba450197-8178-49aa-afd0-28a564a23ace admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:19.079170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:19.079833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:19.080110 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:19.080384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:19.085408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:19.108453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:19.110103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:19.133475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:19.142571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1300/2567] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:18 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:19.162385 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-966585a5-091a-44f9-8a3d-1e99361f300b None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:19.167086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:19.167882 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:19.168228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:19.168563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:19.180662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:19.186585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:19.210019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1268/2568] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:19 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 167 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:19.292334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:19.304758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0e9a0f-5d51-40dc-88b9-72d3cda4ec2b service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:19.312212 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39c8a1-9123-49b9-93f5-f13f509d35fb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:19.313293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39c8a1-9123-49b9-93f5-f13f509d35fb service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:19.314116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39c8a1-9123-49b9-93f5-f13f509d35fb service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:19.314683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e39c8a1-9123-49b9-93f5-f13f509d35fb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:19.387178 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39c8a1-9123-49b9-93f5-f13f509d35fb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:19.388631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e39c8a1-9123-49b9-93f5-f13f509d35fb service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:19.399048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1301/2569] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:19 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:20.081022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:20.083170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:20.147749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c91d05c3-a805-42b1-9baf-756d345127b3 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:20.152434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:20.153284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:20.153589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:20.153862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] PATH_INFO: `/v3/users/ceab30f3a25e4ece83b3512d37e623a1` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:20.155014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ceab30f3a25e4ece83b3512d37e623a1)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:20.156917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:20.202823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ceab30f3a25e4ece83b3512d37e623a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.214102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ceab30f3a25e4ece83b3512d37e623a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.221098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ceab30f3a25e4ece83b3512d37e623a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.229944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ceab30f3a25e4ece83b3512d37e623a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.230699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ceab30f3a25e4ece83b3512d37e623a1'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.236984 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1269/2570] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:20 2022] DELETE /identity/v3/users/ceab30f3a25e4ece83b3512d37e623a1 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:20.480612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39c8a1-9123-49b9-93f5-f13f509d35fb service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:20.492277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e39c8a1-9123-49b9-93f5-f13f509d35fb service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:20.577761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:20.578616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:20.578930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:20.579148 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] PATH_INFO: `/v3/projects/421791010ecd49ef8fedcfd0f354b08f` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:20.580325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=421791010ecd49ef8fedcfd0f354b08f)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:20.582959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:20.633899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '421791010ecd49ef8fedcfd0f354b08f', 'request_id': 'req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.640131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '421791010ecd49ef8fedcfd0f354b08f', 'request_id': 'req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.648145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '421791010ecd49ef8fedcfd0f354b08f', 'request_id': 'req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.656311 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:20.660920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] The token cache is being invalidate because project 421791010ecd49ef8fedcfd0f354b08f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:20.661400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.662438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.664268 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1302/2571] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:20 2022] DELETE /identity/v3/projects/421791010ecd49ef8fedcfd0f354b08f => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:20.668104 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:20.669663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:20.683081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d7428c-723d-4a39-aa14-9b8fa6b07089 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:20.742554 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:20.750145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:20.751038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:20.751293 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:20.751578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] PATH_INFO: `/v3/users/25c8ef98d71f4b719a7baea8b4007866` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:20.752996 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] RBAC: Authorizing `identity:delete_user(user_id=25c8ef98d71f4b719a7baea8b4007866)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:20.756188 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:20.811435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '25c8ef98d71f4b719a7baea8b4007866'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.827748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '25c8ef98d71f4b719a7baea8b4007866'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.836852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '25c8ef98d71f4b719a7baea8b4007866'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.848563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '25c8ef98d71f4b719a7baea8b4007866'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.849220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-680a88ed-9f43-4841-93d2-307b1ad43628 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '25c8ef98d71f4b719a7baea8b4007866'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:20.857599 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1270/2572] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:20 2022] DELETE /identity/v3/users/25c8ef98d71f4b719a7baea8b4007866 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:21.091218 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:21.092661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:21.110211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d6e2ff-5fe5-427e-9dfe-295da4d16c29 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:21.186683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:21.187823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.187823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.188126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] PATH_INFO: `/v3/projects/0dac64656afc408ea203df2b845d68f4` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.189303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0dac64656afc408ea203df2b845d68f4)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:21.191543 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:21.244930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0dac64656afc408ea203df2b845d68f4', 'request_id': 'req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:21.252333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0dac64656afc408ea203df2b845d68f4', 'request_id': 'req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:21.259956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0dac64656afc408ea203df2b845d68f4', 'request_id': 'req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:21.271407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] The token cache is being invalidate because project 0dac64656afc408ea203df2b845d68f4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:21.271695 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:21.272414 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-51b7f7fb-004c-4a2a-b3cc-9ab2e0e9d7f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:21.273993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1303/2573] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:21 2022] DELETE /identity/v3/projects/0dac64656afc408ea203df2b845d68f4 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:21.280074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be92f7b-adee-41f0-87d4-56d4016fc2f3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.280573 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be92f7b-adee-41f0-87d4-56d4016fc2f3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.280678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7be92f7b-adee-41f0-87d4-56d4016fc2f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.300177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7be92f7b-adee-41f0-87d4-56d4016fc2f3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:21.302201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7be92f7b-adee-41f0-87d4-56d4016fc2f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:21.369708 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1271/2574] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:21.377346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2800a5-f7ab-45d6-8a98-d1f467a592e5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.377664 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2800a5-f7ab-45d6-8a98-d1f467a592e5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.377957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b2800a5-f7ab-45d6-8a98-d1f467a592e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.401584 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3b2800a5-f7ab-45d6-8a98-d1f467a592e5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:21.403613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3b2800a5-f7ab-45d6-8a98-d1f467a592e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:21.417777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1304/2575] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:21.421995 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be92f7b-adee-41f0-87d4-56d4016fc2f3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:21.432083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7be92f7b-adee-41f0-87d4-56d4016fc2f3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:21.437229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:21.438186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.438732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.439046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.439883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:21.440377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:21.443128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:21.460204 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1272/2576] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:43:21.461850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2800a5-f7ab-45d6-8a98-d1f467a592e5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:21.471069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b2800a5-f7ab-45d6-8a98-d1f467a592e5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:21.476894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3910e-2478-4ad7-af61-ddd412afc7dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:21.477579 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3910e-2478-4ad7-af61-ddd412afc7dc admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.477858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3910e-2478-4ad7-af61-ddd412afc7dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.478130 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b3910e-2478-4ad7-af61-ddd412afc7dc admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.478822 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3910e-2478-4ad7-af61-ddd412afc7dc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:21.480703 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b3910e-2478-4ad7-af61-ddd412afc7dc admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:21.509330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1305/2577] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:21 2022] POST /identity/v3/projects => generated 381 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:21.514125 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:21.524771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b89697f-5351-40b4-a7d4-6f2e3154aa37 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:21.583698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ab867-39b6-4283-b7e9-2ec4d0845727 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:21.584569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ab867-39b6-4283-b7e9-2ec4d0845727 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.584860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ab867-39b6-4283-b7e9-2ec4d0845727 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.585137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239ab867-39b6-4283-b7e9-2ec4d0845727 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.585900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ab867-39b6-4283-b7e9-2ec4d0845727 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:21.587810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239ab867-39b6-4283-b7e9-2ec4d0845727 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:21.596670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:21.615889 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1273/2578] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:21 2022] POST /identity/v3/users => generated 291 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:21.616866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3910e-2478-4ad7-af61-ddd412afc7dc admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:21.630031 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b3910e-2478-4ad7-af61-ddd412afc7dc admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:21.635162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa047021-bcaa-43b4-89c1-7782f4389b51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:21.635983 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa047021-bcaa-43b4-89c1-7782f4389b51 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.636360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa047021-bcaa-43b4-89c1-7782f4389b51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.636661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa047021-bcaa-43b4-89c1-7782f4389b51 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.637448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa047021-bcaa-43b4-89c1-7782f4389b51 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:21.639100 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa047021-bcaa-43b4-89c1-7782f4389b51 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:21.650979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1306/2579] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:21.655067 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ab867-39b6-4283-b7e9-2ec4d0845727 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:21.665520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239ab867-39b6-4283-b7e9-2ec4d0845727 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:21.670556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49268cff-274a-408b-9650-d6c3e43d6f0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:21.671223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268cff-274a-408b-9650-d6c3e43d6f0a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.671560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268cff-274a-408b-9650-d6c3e43d6f0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.671776 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49268cff-274a-408b-9650-d6c3e43d6f0a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.672497 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49268cff-274a-408b-9650-d6c3e43d6f0a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:21.674251 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49268cff-274a-408b-9650-d6c3e43d6f0a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:21.684347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1274/2580] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:21 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:43:21.688372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa047021-bcaa-43b4-89c1-7782f4389b51 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:21.699359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa047021-bcaa-43b4-89c1-7782f4389b51 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:21.704001 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:21.704914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.705181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.705495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] PATH_INFO: `/v3/projects/98a959cfdf01463e931989f1bbe5baba/users/fd24a76efcff4119a6b1677bf3ec7426/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.726132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] RBAC: Authorizing `identity:create_grant(project_id=98a959cfdf01463e931989f1bbe5baba, user_id=fd24a76efcff4119a6b1677bf3ec7426, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:21.728786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:21.741678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1307/2581] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:21 2022] PUT /identity/v3/projects/98a959cfdf01463e931989f1bbe5baba/users/fd24a76efcff4119a6b1677bf3ec7426/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:21.751918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2338209-8e56-43f8-b745-21aa01601264 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.752146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2338209-8e56-43f8-b745-21aa01601264 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.752426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2338209-8e56-43f8-b745-21aa01601264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.781269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c2338209-8e56-43f8-b745-21aa01601264 None None] MFA Rules not processed for user `fd24a76efcff4119a6b1677bf3ec7426`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:21.782594 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c2338209-8e56-43f8-b745-21aa01601264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:21.867016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1275/2582] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:21 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:21.879456 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:21.881166 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:21.923723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:21.955834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7caf2413-0582-4753-9c5f-5e511ae5a253 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:21.960670 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:21.961357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:21.961658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:21.961981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:21.971075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:21.973683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:21.984821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1308/2583] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:21 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:22.890929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2338209-8e56-43f8-b745-21aa01601264 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:22.892395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c2338209-8e56-43f8-b745-21aa01601264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:22.950961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2338209-8e56-43f8-b745-21aa01601264 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:22.954445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:22.955116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:22.955397 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:22.955673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:22.958715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:23.024448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:23.025935 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:23.036357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1276/2584] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:29.355051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:29.356545 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:29.373850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2211b9e1-f496-4e71-8bd3-a5acbbada0e4 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:29.378287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:29.379874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:29.380150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:29.380418 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] PATH_INFO: `/v3/users/9d7d6f60f4684fbf881a0df657dacc76` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:29.381626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d7d6f60f4684fbf881a0df657dacc76)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:29.383523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:29.434097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d7d6f60f4684fbf881a0df657dacc76'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.443865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d7d6f60f4684fbf881a0df657dacc76'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.452520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d7d6f60f4684fbf881a0df657dacc76'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.464750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d7d6f60f4684fbf881a0df657dacc76'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.465411 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d7d6f60f4684fbf881a0df657dacc76'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.471734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1309/2585] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:29 2022] DELETE /identity/v3/users/9d7d6f60f4684fbf881a0df657dacc76 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:29.647590 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:29.660967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9186c4-2b70-41fb-9008-31a396528209 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:29.681803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:29.726372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:29.727289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:29.727827 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:29.727988 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] PATH_INFO: `/v3/projects/e83cda7bad364c248b71e25345483faf` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:29.729764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e83cda7bad364c248b71e25345483faf)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:29.731977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:29.786998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e83cda7bad364c248b71e25345483faf', 'request_id': 'req-bc0d6558-d256-4b87-91eb-c0b77677f0f7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.793010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e83cda7bad364c248b71e25345483faf', 'request_id': 'req-bc0d6558-d256-4b87-91eb-c0b77677f0f7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.805802 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e83cda7bad364c248b71e25345483faf', 'request_id': 'req-bc0d6558-d256-4b87-91eb-c0b77677f0f7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.818797 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] The token cache is being invalidate because project e83cda7bad364c248b71e25345483faf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:29.819093 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.819839 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.822563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1277/2586] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:29 2022] DELETE /identity/v3/projects/e83cda7bad364c248b71e25345483faf => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:29.826542 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:29.829564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:29.841529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7229382-2ab0-4345-979d-31c5bdba3351 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:29.899065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:29.899868 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:29.900149 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:29.900428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] PATH_INFO: `/v3/users/ec3514b719aa455ebbfcd1b737e9c729` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:29.901924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ec3514b719aa455ebbfcd1b737e9c729)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:29.903843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:29.945889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:29.948405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ec3514b719aa455ebbfcd1b737e9c729'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.956749 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ec3514b719aa455ebbfcd1b737e9c729'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.964379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ec3514b719aa455ebbfcd1b737e9c729'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.976899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ec3514b719aa455ebbfcd1b737e9c729'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.977559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ec3514b719aa455ebbfcd1b737e9c729'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:29.983260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1310/2587] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:29 2022] DELETE /identity/v3/users/ec3514b719aa455ebbfcd1b737e9c729 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:30.162336 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:30.163790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:30.178521 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0d6558-d256-4b87-91eb-c0b77677f0f7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:30.235814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:30.236676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:30.236955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:30.237229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] PATH_INFO: `/v3/projects/79d73a6ae65e4c9f839f466ffbad0c2a` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:30.238696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] RBAC: Authorizing `identity:delete_project(project_id=79d73a6ae65e4c9f839f466ffbad0c2a)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:30.240547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:30.286248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79d73a6ae65e4c9f839f466ffbad0c2a', 'request_id': 'req-adf24dff-0769-41cd-9cb6-915b05c9596d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:30.289948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:30.292131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79d73a6ae65e4c9f839f466ffbad0c2a', 'request_id': 'req-adf24dff-0769-41cd-9cb6-915b05c9596d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:30.299786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79d73a6ae65e4c9f839f466ffbad0c2a', 'request_id': 'req-adf24dff-0769-41cd-9cb6-915b05c9596d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:30.311581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] The token cache is being invalidate because project 79d73a6ae65e4c9f839f466ffbad0c2a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:30.311869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:30.312492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-adf24dff-0769-41cd-9cb6-915b05c9596d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:30.314038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1278/2588] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:30 2022] DELETE /identity/v3/projects/79d73a6ae65e4c9f839f466ffbad0c2a => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:33.649400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:33.651056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:33.669860 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e7ab2d-ee1f-4f74-aa2d-eaf68cea62a5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:33.732976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:33.733883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:33.734162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:33.734431 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] PATH_INFO: `/v3/users/fd24a76efcff4119a6b1677bf3ec7426` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:33.735627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] RBAC: Authorizing `identity:delete_user(user_id=fd24a76efcff4119a6b1677bf3ec7426)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:33.738500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:33.799331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fd24a76efcff4119a6b1677bf3ec7426'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:33.809291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fd24a76efcff4119a6b1677bf3ec7426'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:33.819580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fd24a76efcff4119a6b1677bf3ec7426'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:33.839329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fd24a76efcff4119a6b1677bf3ec7426'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:33.840132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fd24a76efcff4119a6b1677bf3ec7426'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:33.851331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1311/2589] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:33 2022] DELETE /identity/v3/users/fd24a76efcff4119a6b1677bf3ec7426 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:33.852778 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dcaad-d3f6-41ca-8b9a-e97dea37d247 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:33.853264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dcaad-d3f6-41ca-8b9a-e97dea37d247 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:33.853348 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f35dcaad-d3f6-41ca-8b9a-e97dea37d247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:33.880501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f35dcaad-d3f6-41ca-8b9a-e97dea37d247 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:33.881964 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f35dcaad-d3f6-41ca-8b9a-e97dea37d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:33.985472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1279/2590] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:33.994640 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:33.997000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:34.054352 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:DELETE=14,keystone:SELECT=84,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:34.074803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed3c987-22ec-4451-97ec-76b08e8f316d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:34.080432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6241a862-37e7-4349-9cd7-0a584f17bfd2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:34.081780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a862-37e7-4349-9cd7-0a584f17bfd2 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:34.082360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a862-37e7-4349-9cd7-0a584f17bfd2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:34.082636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6241a862-37e7-4349-9cd7-0a584f17bfd2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:34.097910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241a862-37e7-4349-9cd7-0a584f17bfd2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:34.099442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6241a862-37e7-4349-9cd7-0a584f17bfd2 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:34.111917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1312/2591] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:34.424167 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dcaad-d3f6-41ca-8b9a-e97dea37d247 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:34.428197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f35dcaad-d3f6-41ca-8b9a-e97dea37d247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:34.454227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f35dcaad-d3f6-41ca-8b9a-e97dea37d247 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:34.459733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:34.460607 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:34.460888 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:34.461226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] PATH_INFO: `/v3/projects/98a959cfdf01463e931989f1bbe5baba` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:34.462389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] RBAC: Authorizing `identity:delete_project(project_id=98a959cfdf01463e931989f1bbe5baba)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:34.464347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:34.531126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '98a959cfdf01463e931989f1bbe5baba', 'request_id': 'req-6373cc9b-2896-440a-82a2-048a3fd52356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:34.536769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '98a959cfdf01463e931989f1bbe5baba', 'request_id': 'req-6373cc9b-2896-440a-82a2-048a3fd52356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:34.550932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '98a959cfdf01463e931989f1bbe5baba', 'request_id': 'req-6373cc9b-2896-440a-82a2-048a3fd52356'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:34.573625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] The token cache is being invalidate because project 98a959cfdf01463e931989f1bbe5baba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:34.574083 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:34.574953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-6373cc9b-2896-440a-82a2-048a3fd52356 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:34.580033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1280/2592] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:34 2022] DELETE /identity/v3/projects/98a959cfdf01463e931989f1bbe5baba => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:34.582876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c08f3-67e0-488b-9d1a-06eea38fecad None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:34.583177 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c08f3-67e0-488b-9d1a-06eea38fecad None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:34.583653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325c08f3-67e0-488b-9d1a-06eea38fecad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:34.604334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-325c08f3-67e0-488b-9d1a-06eea38fecad None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:34.605691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-325c08f3-67e0-488b-9d1a-06eea38fecad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:34.673477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1313/2593] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:34.681271 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf603-66ff-4ec7-a11e-1521b2c159a3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:34.681681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf603-66ff-4ec7-a11e-1521b2c159a3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:34.681967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39abf603-66ff-4ec7-a11e-1521b2c159a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:34.702741 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-39abf603-66ff-4ec7-a11e-1521b2c159a3 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:34.704218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-39abf603-66ff-4ec7-a11e-1521b2c159a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:34.713380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1281/2594] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:34.717999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c08f3-67e0-488b-9d1a-06eea38fecad None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:34.729131 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325c08f3-67e0-488b-9d1a-06eea38fecad None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:34.734691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:34.735389 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:34.735769 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:34.735900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:34.736647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:34.737033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:34.739187 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:34.757485 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1314/2595] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:43:34.759375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abf603-66ff-4ec7-a11e-1521b2c159a3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:34.771309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39abf603-66ff-4ec7-a11e-1521b2c159a3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:34.780944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606f9d9-53c4-4285-ae25-0e4ec59f6bd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:34.781656 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606f9d9-53c4-4285-ae25-0e4ec59f6bd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:34.781942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606f9d9-53c4-4285-ae25-0e4ec59f6bd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:34.782220 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0606f9d9-53c4-4285-ae25-0e4ec59f6bd6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:34.782934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606f9d9-53c4-4285-ae25-0e4ec59f6bd6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:34.786032 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0606f9d9-53c4-4285-ae25-0e4ec59f6bd6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:34.816699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1282/2596] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:34 2022] POST /identity/v3/projects => generated 363 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:34.821028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:34.832468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ccc25dd-9f8c-4411-94aa-5e4041fcff8f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:34.907655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa27dc-8061-4d75-b59d-4eaf50014d99 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:34.908631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa27dc-8061-4d75-b59d-4eaf50014d99 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:34.908820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa27dc-8061-4d75-b59d-4eaf50014d99 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:34.909162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31fa27dc-8061-4d75-b59d-4eaf50014d99 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:34.910493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa27dc-8061-4d75-b59d-4eaf50014d99 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:34.912649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31fa27dc-8061-4d75-b59d-4eaf50014d99 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:34.938167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1315/2597] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:34 2022] POST /identity/v3/users => generated 282 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:34.943023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606f9d9-53c4-4285-ae25-0e4ec59f6bd6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:34.955222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0606f9d9-53c4-4285-ae25-0e4ec59f6bd6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:34.962440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ef1f1-1701-4bef-a48f-8f0d4251990d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:34.963310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ef1f1-1701-4bef-a48f-8f0d4251990d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:34.963659 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ef1f1-1701-4bef-a48f-8f0d4251990d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:34.964031 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9ef1f1-1701-4bef-a48f-8f0d4251990d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:34.964903 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ef1f1-1701-4bef-a48f-8f0d4251990d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:34.966904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9ef1f1-1701-4bef-a48f-8f0d4251990d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:34.979685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1283/2598] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:34.983742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa27dc-8061-4d75-b59d-4eaf50014d99 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:34.994259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31fa27dc-8061-4d75-b59d-4eaf50014d99 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:34.999280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c63bb7-8cc1-437b-a71d-095a39987143 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:34.999951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c63bb7-8cc1-437b-a71d-095a39987143 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:35.000234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c63bb7-8cc1-437b-a71d-095a39987143 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:35.000517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c63bb7-8cc1-437b-a71d-095a39987143 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:35.001231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c63bb7-8cc1-437b-a71d-095a39987143 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:35.002869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c63bb7-8cc1-437b-a71d-095a39987143 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:35.017686 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1316/2599] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:34 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:35.021681 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ef1f1-1701-4bef-a48f-8f0d4251990d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:35.033725 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9ef1f1-1701-4bef-a48f-8f0d4251990d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:35.039490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:35.040412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:35.040700 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:35.040982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] PATH_INFO: `/v3/projects/275f009e882849f5acea647caf016a45/users/22bad16daba543c89dabe699b41b24b4/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:35.059479 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=275f009e882849f5acea647caf016a45, user_id=22bad16daba543c89dabe699b41b24b4, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:35.062901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:35.079770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1284/2600] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:35 2022] PUT /identity/v3/projects/275f009e882849f5acea647caf016a45/users/22bad16daba543c89dabe699b41b24b4/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:35.090649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e1b1-0e85-4874-987f-d828224aedf8 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:35.090942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e1b1-0e85-4874-987f-d828224aedf8 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:35.091236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d7e1b1-0e85-4874-987f-d828224aedf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:35.118705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c7d7e1b1-0e85-4874-987f-d828224aedf8 None None] MFA Rules not processed for user `22bad16daba543c89dabe699b41b24b4`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:35.119911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c7d7e1b1-0e85-4874-987f-d828224aedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:35.160209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:35.188181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1317/2601] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:35 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:35.200246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:35.202057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:35.208142 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:35.263565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbe65c9d-230e-4f1c-a86a-8890c77b5e4a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:35.267139 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:35.267803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:35.268069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:35.268341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:35.278089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:35.279526 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:35.288817 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1285/2602] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:35 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:37.842051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e1b1-0e85-4874-987f-d828224aedf8 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:37.843472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c7d7e1b1-0e85-4874-987f-d828224aedf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:37.899528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d7e1b1-0e85-4874-987f-d828224aedf8 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:37.903284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:37.903913 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:37.904193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:37.904465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:37.906201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:37.968669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:37.970046 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:37.980168 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1318/2603] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:41.293114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:41.294701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:41.312064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a623f14c-2ebb-4871-9212-c739b8e0be4b service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:41.316553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:41.317427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:41.317723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:41.317999 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] PATH_INFO: `/v3/users/0a028c1d97ce4951bdbb707b772baffe` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:41.319205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0a028c1d97ce4951bdbb707b772baffe)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:41.321117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:41.367360 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0a028c1d97ce4951bdbb707b772baffe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.378915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0a028c1d97ce4951bdbb707b772baffe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.385570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0a028c1d97ce4951bdbb707b772baffe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.392862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0a028c1d97ce4951bdbb707b772baffe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.393494 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-70f7b4aa-6b27-46a1-80b6-825fc4cc2ef3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0a028c1d97ce4951bdbb707b772baffe'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.400037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1286/2604] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:41 2022] DELETE /identity/v3/users/0a028c1d97ce4951bdbb707b772baffe => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:41.577740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:41.588023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2bd0ed6-342e-4110-8f5e-3e73fd17c23b service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:41.653866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:41.654728 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:41.655002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:41.655274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] PATH_INFO: `/v3/projects/20b7d0ebe9f740b9be0e1c7bcba9e840` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:41.656440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] RBAC: Authorizing `identity:delete_project(project_id=20b7d0ebe9f740b9be0e1c7bcba9e840)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:41.658380 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:41.694993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:41.709785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '20b7d0ebe9f740b9be0e1c7bcba9e840', 'request_id': 'req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.716290 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '20b7d0ebe9f740b9be0e1c7bcba9e840', 'request_id': 'req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.724886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '20b7d0ebe9f740b9be0e1c7bcba9e840', 'request_id': 'req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.738149 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] The token cache is being invalidate because project 20b7d0ebe9f740b9be0e1c7bcba9e840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:41.738444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.739114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-d8d93a7d-eea1-4d3b-b90c-74ee2d347501 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:41.740685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1319/2605] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:41 2022] DELETE /identity/v3/projects/20b7d0ebe9f740b9be0e1c7bcba9e840 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:41.745621 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e00c14-a9d9-47ea-a8f3-aebf447373bf None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:41.745918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e00c14-a9d9-47ea-a8f3-aebf447373bf None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:41.746198 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90e00c14-a9d9-47ea-a8f3-aebf447373bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:41.763806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-90e00c14-a9d9-47ea-a8f3-aebf447373bf None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:41.765029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-90e00c14-a9d9-47ea-a8f3-aebf447373bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:41.827416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1287/2606] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:41.835804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3794-77ca-4a9c-aa9b-478f05d8bde5 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:41.836091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3794-77ca-4a9c-aa9b-478f05d8bde5 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:41.836369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3794-77ca-4a9c-aa9b-478f05d8bde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:41.854120 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d68e3794-77ca-4a9c-aa9b-478f05d8bde5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:41.855321 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d68e3794-77ca-4a9c-aa9b-478f05d8bde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:41.863172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1320/2607] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:41.867209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e00c14-a9d9-47ea-a8f3-aebf447373bf None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:41.877091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90e00c14-a9d9-47ea-a8f3-aebf447373bf None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:41.882386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:41.883038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:41.883317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:41.883698 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:41.884299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:41.884600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:41.886216 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:41.902059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1288/2608] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:43:41.903158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3794-77ca-4a9c-aa9b-478f05d8bde5 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:41.913214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3794-77ca-4a9c-aa9b-478f05d8bde5 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:41.917755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba85cdc-f0c5-45b5-8336-2bb012335367 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:41.918393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85cdc-f0c5-45b5-8336-2bb012335367 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:41.918667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85cdc-f0c5-45b5-8336-2bb012335367 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:41.918932 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba85cdc-f0c5-45b5-8336-2bb012335367 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:41.919735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba85cdc-f0c5-45b5-8336-2bb012335367 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:41.921658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba85cdc-f0c5-45b5-8336-2bb012335367 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:41.953852 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1321/2609] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:41 2022] POST /identity/v3/projects => generated 403 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:41.958652 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:41.965305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:41.969213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5514468d-6acd-4179-9629-3eb5095fd461 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.032932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5260-66a2-476d-8aff-d305fd5c6c26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.033629 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5260-66a2-476d-8aff-d305fd5c6c26 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.033911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5260-66a2-476d-8aff-d305fd5c6c26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.034180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2f5260-66a2-476d-8aff-d305fd5c6c26 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.035902 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5260-66a2-476d-8aff-d305fd5c6c26 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.037880 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2f5260-66a2-476d-8aff-d305fd5c6c26 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.062200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1289/2610] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:41 2022] POST /identity/v3/users => generated 302 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:42.067372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba85cdc-f0c5-45b5-8336-2bb012335367 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.082689 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba85cdc-f0c5-45b5-8336-2bb012335367 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.094911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6665d67-e8e0-482b-8d9c-bcc65f39190d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.094911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6665d67-e8e0-482b-8d9c-bcc65f39190d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.094911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6665d67-e8e0-482b-8d9c-bcc65f39190d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.094911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6665d67-e8e0-482b-8d9c-bcc65f39190d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.095832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6665d67-e8e0-482b-8d9c-bcc65f39190d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.098814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6665d67-e8e0-482b-8d9c-bcc65f39190d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.110808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1322/2611] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:42.115171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5260-66a2-476d-8aff-d305fd5c6c26 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.125670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2f5260-66a2-476d-8aff-d305fd5c6c26 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.130865 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97dc2cd-56d1-4327-8ccb-9029765c187e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.131735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc2cd-56d1-4327-8ccb-9029765c187e admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.132116 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc2cd-56d1-4327-8ccb-9029765c187e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.132490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97dc2cd-56d1-4327-8ccb-9029765c187e admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.133381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dc2cd-56d1-4327-8ccb-9029765c187e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.135094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b97dc2cd-56d1-4327-8ccb-9029765c187e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.145749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1290/2612] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:42.151787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6665d67-e8e0-482b-8d9c-bcc65f39190d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.164102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6665d67-e8e0-482b-8d9c-bcc65f39190d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.168635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ed04c-f1d4-40a7-99d0-d7409bad4601 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.169535 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed04c-f1d4-40a7-99d0-d7409bad4601 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.169816 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed04c-f1d4-40a7-99d0-d7409bad4601 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.170087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161ed04c-f1d4-40a7-99d0-d7409bad4601 admin admin] PATH_INFO: `/v3/projects/9360215c8bf94f38b116eee9a01fae15/users/3e13420707ea4e97826cd8fec371e0b1/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.185607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ed04c-f1d4-40a7-99d0-d7409bad4601 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9360215c8bf94f38b116eee9a01fae15, user_id=3e13420707ea4e97826cd8fec371e0b1, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.188266 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161ed04c-f1d4-40a7-99d0-d7409bad4601 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.209782 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1323/2613] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:42 2022] PUT /identity/v3/projects/9360215c8bf94f38b116eee9a01fae15/users/3e13420707ea4e97826cd8fec371e0b1/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:42.219577 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83751-f769-4161-8e77-a286ccf130e3 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.220133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83751-f769-4161-8e77-a286ccf130e3 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.220414 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28d83751-f769-4161-8e77-a286ccf130e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.252108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-28d83751-f769-4161-8e77-a286ccf130e3 None None] MFA Rules not processed for user `3e13420707ea4e97826cd8fec371e0b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:42.253662 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-28d83751-f769-4161-8e77-a286ccf130e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:42.319695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1291/2614] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:42 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:42.324221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ed04c-f1d4-40a7-99d0-d7409bad4601 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.385994 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161ed04c-f1d4-40a7-99d0-d7409bad4601 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.390493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83aac7-9250-458a-8951-e25577c2a396 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.391139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83aac7-9250-458a-8951-e25577c2a396 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.391415 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83aac7-9250-458a-8951-e25577c2a396 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.391685 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f83aac7-9250-458a-8951-e25577c2a396 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.392359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83aac7-9250-458a-8951-e25577c2a396 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.394881 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f83aac7-9250-458a-8951-e25577c2a396 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.424889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1324/2615] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:42 2022] POST /identity/v3/projects => generated 405 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:42.426403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d83751-f769-4161-8e77-a286ccf130e3 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.437208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28d83751-f769-4161-8e77-a286ccf130e3 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.492038 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d342da-6be3-4222-aa54-514d3ba92090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.492740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d342da-6be3-4222-aa54-514d3ba92090 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.493025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d342da-6be3-4222-aa54-514d3ba92090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.493315 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d342da-6be3-4222-aa54-514d3ba92090 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.494008 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d342da-6be3-4222-aa54-514d3ba92090 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.495939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d342da-6be3-4222-aa54-514d3ba92090 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.515296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1292/2616] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:42 2022] POST /identity/v3/users => generated 309 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:42.519359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83aac7-9250-458a-8951-e25577c2a396 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.529780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f83aac7-9250-458a-8951-e25577c2a396 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.534845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7cfed-b9a1-48f0-b886-d52eee74518f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.535501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7cfed-b9a1-48f0-b886-d52eee74518f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.535778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7cfed-b9a1-48f0-b886-d52eee74518f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.536058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d7cfed-b9a1-48f0-b886-d52eee74518f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.536938 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7cfed-b9a1-48f0-b886-d52eee74518f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.538563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d7cfed-b9a1-48f0-b886-d52eee74518f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.548838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1325/2617] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:42.553321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d342da-6be3-4222-aa54-514d3ba92090 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.558453 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:42.564435 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d342da-6be3-4222-aa54-514d3ba92090 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.569478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d674d-d553-490f-bd97-136a46c71272 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.570342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d674d-d553-490f-bd97-136a46c71272 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.570626 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d674d-d553-490f-bd97-136a46c71272 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.570898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-188d674d-d553-490f-bd97-136a46c71272 admin admin] PATH_INFO: `/v3/projects/c4f0180b74bd40748cc052bece0f0544/users/3c9ca02761e346aaa2c8feeccf033f47/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.585202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d674d-d553-490f-bd97-136a46c71272 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f0180b74bd40748cc052bece0f0544, user_id=3c9ca02761e346aaa2c8feeccf033f47, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.587856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-188d674d-d553-490f-bd97-136a46c71272 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.600922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1293/2618] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:42 2022] PUT /identity/v3/projects/c4f0180b74bd40748cc052bece0f0544/users/3c9ca02761e346aaa2c8feeccf033f47/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:42.604832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7cfed-b9a1-48f0-b886-d52eee74518f admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.615406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d7cfed-b9a1-48f0-b886-d52eee74518f admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.640578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:42.673089 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f69bbbc-1f7d-40a4-86d3-b235c7b51c16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.673805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69bbbc-1f7d-40a4-86d3-b235c7b51c16 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.674081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69bbbc-1f7d-40a4-86d3-b235c7b51c16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.674354 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f69bbbc-1f7d-40a4-86d3-b235c7b51c16 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.675293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69bbbc-1f7d-40a4-86d3-b235c7b51c16 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.676897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f69bbbc-1f7d-40a4-86d3-b235c7b51c16 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.686529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1326/2619] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:42 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:42.691288 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d674d-d553-490f-bd97-136a46c71272 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.701523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-188d674d-d553-490f-bd97-136a46c71272 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.707185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.708058 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.708337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.708611 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] PATH_INFO: `/v3/projects/c4f0180b74bd40748cc052bece0f0544/users/3c9ca02761e346aaa2c8feeccf033f47/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.710716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] RBAC: Authorizing `identity:create_grant(project_id=c4f0180b74bd40748cc052bece0f0544, user_id=3c9ca02761e346aaa2c8feeccf033f47, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.713321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.723412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1294/2620] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:42 2022] PUT /identity/v3/projects/c4f0180b74bd40748cc052bece0f0544/users/3c9ca02761e346aaa2c8feeccf033f47/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:42.734475 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27e29-ffb6-4516-89b6-eec66209a972 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.734763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27e29-ffb6-4516-89b6-eec66209a972 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.735039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71c27e29-ffb6-4516-89b6-eec66209a972 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.761219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-71c27e29-ffb6-4516-89b6-eec66209a972 None None] MFA Rules not processed for user `3c9ca02761e346aaa2c8feeccf033f47`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:42.762445 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-71c27e29-ffb6-4516-89b6-eec66209a972 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:42.827504 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1327/2621] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:42 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:42.839086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:42.840758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:42.897500 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d707f10b-6545-4eba-ac85-1af120c8778f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:42.900947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dafcc465-9316-4a60-b94c-cffdeccdbc8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:42.901926 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcc465-9316-4a60-b94c-cffdeccdbc8c service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:42.902206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcc465-9316-4a60-b94c-cffdeccdbc8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:42.902478 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dafcc465-9316-4a60-b94c-cffdeccdbc8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:42.912019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcc465-9316-4a60-b94c-cffdeccdbc8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:42.913465 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dafcc465-9316-4a60-b94c-cffdeccdbc8c service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:42.922598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1295/2622] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:42 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:45.234167 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c27e29-ffb6-4516-89b6-eec66209a972 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:45.298224 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71c27e29-ffb6-4516-89b6-eec66209a972 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:45.303620 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:45.304961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:45.305391 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:45.305910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] PATH_INFO: `/v3/users/3e13420707ea4e97826cd8fec371e0b1` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:45.307748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3e13420707ea4e97826cd8fec371e0b1)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:45.310371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:45.357205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3e13420707ea4e97826cd8fec371e0b1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.361669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:45.365780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3e13420707ea4e97826cd8fec371e0b1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.374902 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3e13420707ea4e97826cd8fec371e0b1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.388995 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3e13420707ea4e97826cd8fec371e0b1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.389711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3e13420707ea4e97826cd8fec371e0b1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.397675 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1328/2623] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:45 2022] DELETE /identity/v3/users/3e13420707ea4e97826cd8fec371e0b1 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:45.402932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f5ce-b5ea-422f-8daa-30d4de5aa375 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:45.403384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f5ce-b5ea-422f-8daa-30d4de5aa375 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:45.403633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f50f5ce-b5ea-422f-8daa-30d4de5aa375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:45.422418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9f50f5ce-b5ea-422f-8daa-30d4de5aa375 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:45.423638 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9f50f5ce-b5ea-422f-8daa-30d4de5aa375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:45.482042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1296/2624] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:45.491833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:45.493284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:45.557228 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2380c641-ae8a-4206-a505-00aaaa667909 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:45.560831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf865-1403-4417-87c5-dd8eabcda5bd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:45.561508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf865-1403-4417-87c5-dd8eabcda5bd service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:45.561791 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf865-1403-4417-87c5-dd8eabcda5bd service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:45.562065 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ccf865-1403-4417-87c5-dd8eabcda5bd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:45.571761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccf865-1403-4417-87c5-dd8eabcda5bd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:45.573180 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ccf865-1403-4417-87c5-dd8eabcda5bd service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:45.583087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1329/2625] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:45.850327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50f5ce-b5ea-422f-8daa-30d4de5aa375 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:45.851758 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9f50f5ce-b5ea-422f-8daa-30d4de5aa375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:45.865094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f50f5ce-b5ea-422f-8daa-30d4de5aa375 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:45.869983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:45.870835 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:45.871113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:45.871382 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] PATH_INFO: `/v3/projects/9360215c8bf94f38b116eee9a01fae15` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:45.872602 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9360215c8bf94f38b116eee9a01fae15)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:45.874574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:45.919823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9360215c8bf94f38b116eee9a01fae15', 'request_id': 'req-a5da0fa6-f07b-423a-a382-9934d7c03613'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.925102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9360215c8bf94f38b116eee9a01fae15', 'request_id': 'req-a5da0fa6-f07b-423a-a382-9934d7c03613'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.929079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:45.933398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9360215c8bf94f38b116eee9a01fae15', 'request_id': 'req-a5da0fa6-f07b-423a-a382-9934d7c03613'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.945838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] The token cache is being invalidate because project 9360215c8bf94f38b116eee9a01fae15 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:45.946122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.946743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:45.948263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1297/2626] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:45 2022] DELETE /identity/v3/projects/9360215c8bf94f38b116eee9a01fae15 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:45.952156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf865-1403-4417-87c5-dd8eabcda5bd service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:45.961753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ccf865-1403-4417-87c5-dd8eabcda5bd service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:46.018211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:46.019067 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.019348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.019653 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] PATH_INFO: `/v3/users/3c9ca02761e346aaa2c8feeccf033f47` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.020982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c9ca02761e346aaa2c8feeccf033f47)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:46.022930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:46.068591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c9ca02761e346aaa2c8feeccf033f47'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.075230 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c9ca02761e346aaa2c8feeccf033f47'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.081651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c9ca02761e346aaa2c8feeccf033f47'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.090252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=86,keystone:INSERT=2,keystone:DELETE=12 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:46.095349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c9ca02761e346aaa2c8feeccf033f47'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.096233 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-58e399e1-4ad4-4246-aa9c-044830d48a1c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c9ca02761e346aaa2c8feeccf033f47'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.104336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1330/2627] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:45 2022] DELETE /identity/v3/users/3c9ca02761e346aaa2c8feeccf033f47 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:46.374552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:46.375971 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:46.389306 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5da0fa6-f07b-423a-a382-9934d7c03613 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:46.448191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:46.449049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.449326 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.449627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] PATH_INFO: `/v3/projects/c4f0180b74bd40748cc052bece0f0544` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.450847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c4f0180b74bd40748cc052bece0f0544)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:46.452731 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:46.499389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c4f0180b74bd40748cc052bece0f0544', 'request_id': 'req-89f30ad4-3079-441c-badd-38b2ee077775'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.505159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c4f0180b74bd40748cc052bece0f0544', 'request_id': 'req-89f30ad4-3079-441c-badd-38b2ee077775'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.512794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c4f0180b74bd40748cc052bece0f0544', 'request_id': 'req-89f30ad4-3079-441c-badd-38b2ee077775'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.524274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] The token cache is being invalidate because project c4f0180b74bd40748cc052bece0f0544 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:46.524576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.525186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89f30ad4-3079-441c-badd-38b2ee077775 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:46.527009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1298/2628] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:46 2022] DELETE /identity/v3/projects/c4f0180b74bd40748cc052bece0f0544 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:46.533469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c4681-9065-46d5-b489-580ec1cef539 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.533933 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c4681-9065-46d5-b489-580ec1cef539 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.534028 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b15c4681-9065-46d5-b489-580ec1cef539 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.553490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-b15c4681-9065-46d5-b489-580ec1cef539 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:46.554709 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b15c4681-9065-46d5-b489-580ec1cef539 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:46.619819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1331/2629] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:46.627443 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e2da-3ed1-4953-b965-3074ebebef10 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.627740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e2da-3ed1-4953-b965-3074ebebef10 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.628018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5345e2da-3ed1-4953-b965-3074ebebef10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.646574 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5345e2da-3ed1-4953-b965-3074ebebef10 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:46.647782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5345e2da-3ed1-4953-b965-3074ebebef10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:46.655876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1299/2630] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:46.660119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c4681-9065-46d5-b489-580ec1cef539 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:46.670401 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b15c4681-9065-46d5-b489-580ec1cef539 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:46.674796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:46.675429 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.675705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.675974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.676903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:46.677203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:46.678820 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:46.690281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1332/2631] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:43:46.694496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345e2da-3ed1-4953-b965-3074ebebef10 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:46.703836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5345e2da-3ed1-4953-b965-3074ebebef10 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:46.709248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945697ac-de0b-42b6-92a4-2c32137185d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:46.709927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945697ac-de0b-42b6-92a4-2c32137185d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.710236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945697ac-de0b-42b6-92a4-2c32137185d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.710513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-945697ac-de0b-42b6-92a4-2c32137185d1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.711217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945697ac-de0b-42b6-92a4-2c32137185d1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:46.713109 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-945697ac-de0b-42b6-92a4-2c32137185d1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:46.739052 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1300/2632] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:46 2022] POST /identity/v3/projects => generated 383 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:46.742989 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:46.753126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de96ee29-47f2-45f5-872e-179ae5fe1e94 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:46.808207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5eac-f5d9-4b32-b97b-faa6031074a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:46.808896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5eac-f5d9-4b32-b97b-faa6031074a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.809284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5eac-f5d9-4b32-b97b-faa6031074a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.809597 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79b5eac-f5d9-4b32-b97b-faa6031074a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.810286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b5eac-f5d9-4b32-b97b-faa6031074a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:46.812227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79b5eac-f5d9-4b32-b97b-faa6031074a4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:46.831075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1333/2633] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:46 2022] POST /identity/v3/users => generated 292 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:46.835723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945697ac-de0b-42b6-92a4-2c32137185d1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:46.845834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-945697ac-de0b-42b6-92a4-2c32137185d1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:46.850930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80aabf-97ed-46b0-b6f8-c810c58833a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:46.851575 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80aabf-97ed-46b0-b6f8-c810c58833a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.851858 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80aabf-97ed-46b0-b6f8-c810c58833a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.852135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd80aabf-97ed-46b0-b6f8-c810c58833a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.852861 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80aabf-97ed-46b0-b6f8-c810c58833a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:46.854490 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd80aabf-97ed-46b0-b6f8-c810c58833a2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:46.865010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1301/2634] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:46.868696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5eac-f5d9-4b32-b97b-faa6031074a4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:46.878459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79b5eac-f5d9-4b32-b97b-faa6031074a4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:46.883612 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865e6be5-4652-4d57-9bbf-18c08acfd1f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:46.884250 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6be5-4652-4d57-9bbf-18c08acfd1f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.884562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6be5-4652-4d57-9bbf-18c08acfd1f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.884835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865e6be5-4652-4d57-9bbf-18c08acfd1f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.885587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e6be5-4652-4d57-9bbf-18c08acfd1f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:46.887164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865e6be5-4652-4d57-9bbf-18c08acfd1f3 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:46.897726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1334/2635] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:46 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:46.902021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80aabf-97ed-46b0-b6f8-c810c58833a2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:46.911896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd80aabf-97ed-46b0-b6f8-c810c58833a2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:46.916390 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffedcf3-0e2e-4d31-972a-f765fbe46b3c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:46.917242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffedcf3-0e2e-4d31-972a-f765fbe46b3c admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.917549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffedcf3-0e2e-4d31-972a-f765fbe46b3c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.917833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ffedcf3-0e2e-4d31-972a-f765fbe46b3c admin admin] PATH_INFO: `/v3/projects/a06e21b7dad545d9b5aa27370a3d16de/users/c22524b4440d42ce98b09043174b42ab/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.932122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffedcf3-0e2e-4d31-972a-f765fbe46b3c admin admin] RBAC: Authorizing `identity:create_grant(project_id=a06e21b7dad545d9b5aa27370a3d16de, user_id=c22524b4440d42ce98b09043174b42ab, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:46.934872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ffedcf3-0e2e-4d31-972a-f765fbe46b3c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:46.947710 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1302/2636] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:46 2022] PUT /identity/v3/projects/a06e21b7dad545d9b5aa27370a3d16de/users/c22524b4440d42ce98b09043174b42ab/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:46.958508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689a20-0a7c-473c-be97-8cad0b1551a1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:46.958793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689a20-0a7c-473c-be97-8cad0b1551a1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:46.959066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2689a20-0a7c-473c-be97-8cad0b1551a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:46.991304 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e2689a20-0a7c-473c-be97-8cad0b1551a1 None None] MFA Rules not processed for user `c22524b4440d42ce98b09043174b42ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:46.992512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e2689a20-0a7c-473c-be97-8cad0b1551a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:47.038316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:DELETE=1,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:47.058783 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1335/2637] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:46 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:47.063211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffedcf3-0e2e-4d31-972a-f765fbe46b3c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:47.083095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:47.125100 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ffedcf3-0e2e-4d31-972a-f765fbe46b3c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:47.130161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397663-832c-4627-9608-115c1e33fe64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:47.130856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397663-832c-4627-9608-115c1e33fe64 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.131137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397663-832c-4627-9608-115c1e33fe64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.131408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a397663-832c-4627-9608-115c1e33fe64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.132089 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a397663-832c-4627-9608-115c1e33fe64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:47.134095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a397663-832c-4627-9608-115c1e33fe64 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:47.159033 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1303/2638] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:47 2022] POST /identity/v3/projects => generated 383 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:47.163296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2689a20-0a7c-473c-be97-8cad0b1551a1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:47.174058 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2689a20-0a7c-473c-be97-8cad0b1551a1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:47.230145 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c91f0-4b4c-4d38-b248-a685fce152d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:47.230813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c91f0-4b4c-4d38-b248-a685fce152d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.231095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c91f0-4b4c-4d38-b248-a685fce152d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.231373 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853c91f0-4b4c-4d38-b248-a685fce152d9 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.232069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c91f0-4b4c-4d38-b248-a685fce152d9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:47.234021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853c91f0-4b4c-4d38-b248-a685fce152d9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:47.255333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1336/2639] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:47 2022] POST /identity/v3/users => generated 298 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:47.259336 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397663-832c-4627-9608-115c1e33fe64 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:47.269674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a397663-832c-4627-9608-115c1e33fe64 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:47.274365 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f9aff-906b-4b36-8f8c-aad84a8fe2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:47.275010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f9aff-906b-4b36-8f8c-aad84a8fe2f7 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.275292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f9aff-906b-4b36-8f8c-aad84a8fe2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.275565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f9aff-906b-4b36-8f8c-aad84a8fe2f7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.276277 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f9aff-906b-4b36-8f8c-aad84a8fe2f7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:47.278162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5f9aff-906b-4b36-8f8c-aad84a8fe2f7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:47.288910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1304/2640] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:47.293013 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c91f0-4b4c-4d38-b248-a685fce152d9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:47.304458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853c91f0-4b4c-4d38-b248-a685fce152d9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:47.310248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e21ff-422f-4a19-984d-3266357f3bc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:47.311125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e21ff-422f-4a19-984d-3266357f3bc1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.311406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e21ff-422f-4a19-984d-3266357f3bc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.311680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17e21ff-422f-4a19-984d-3266357f3bc1 admin admin] PATH_INFO: `/v3/projects/414a5f12fdaf4b748e09b034a49327a0/users/e1ed95de2f77482083a7c9b2d07ae2ff/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.326953 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e21ff-422f-4a19-984d-3266357f3bc1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=414a5f12fdaf4b748e09b034a49327a0, user_id=e1ed95de2f77482083a7c9b2d07ae2ff, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:47.329633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17e21ff-422f-4a19-984d-3266357f3bc1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:47.342467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1337/2641] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:47 2022] PUT /identity/v3/projects/414a5f12fdaf4b748e09b034a49327a0/users/e1ed95de2f77482083a7c9b2d07ae2ff/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:47.346416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f9aff-906b-4b36-8f8c-aad84a8fe2f7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:47.357217 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5f9aff-906b-4b36-8f8c-aad84a8fe2f7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:47.412039 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65cb959d-44b4-4101-9c3e-e3921a6cab8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:47.412695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb959d-44b4-4101-9c3e-e3921a6cab8a admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.412975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb959d-44b4-4101-9c3e-e3921a6cab8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.413253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65cb959d-44b4-4101-9c3e-e3921a6cab8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.414063 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb959d-44b4-4101-9c3e-e3921a6cab8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:47.415680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65cb959d-44b4-4101-9c3e-e3921a6cab8a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:47.425896 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1305/2642] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:47 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:47.430564 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e21ff-422f-4a19-984d-3266357f3bc1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:47.440810 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17e21ff-422f-4a19-984d-3266357f3bc1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:47.445963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:47.446818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.447096 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.447364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] PATH_INFO: `/v3/projects/414a5f12fdaf4b748e09b034a49327a0/users/e1ed95de2f77482083a7c9b2d07ae2ff/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.449291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] RBAC: Authorizing `identity:create_grant(project_id=414a5f12fdaf4b748e09b034a49327a0, user_id=e1ed95de2f77482083a7c9b2d07ae2ff, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:47.452026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:47.461948 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1338/2643] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:47 2022] PUT /identity/v3/projects/414a5f12fdaf4b748e09b034a49327a0/users/e1ed95de2f77482083a7c9b2d07ae2ff/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:47.473206 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336c20-ab51-4cd8-aee2-5f23b6505e9d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.473719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336c20-ab51-4cd8-aee2-5f23b6505e9d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.474005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63336c20-ab51-4cd8-aee2-5f23b6505e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.500885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-63336c20-ab51-4cd8-aee2-5f23b6505e9d None None] MFA Rules not processed for user `e1ed95de2f77482083a7c9b2d07ae2ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:47.502108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-63336c20-ab51-4cd8-aee2-5f23b6505e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:47.569803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1306/2644] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:47 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:47.580385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:47.582070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:47.644514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53ace61c-8622-4e5d-9124-456765a56ffe admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:47.648366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40c3f-c10c-45c6-91c5-2175d7d51cb2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:47.649009 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40c3f-c10c-45c6-91c5-2175d7d51cb2 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.649288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40c3f-c10c-45c6-91c5-2175d7d51cb2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.649594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb40c3f-c10c-45c6-91c5-2175d7d51cb2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.658840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40c3f-c10c-45c6-91c5-2175d7d51cb2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:47.660267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0eb40c3f-c10c-45c6-91c5-2175d7d51cb2 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:47.670095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1339/2645] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:47 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:47.765990 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63336c20-ab51-4cd8-aee2-5f23b6505e9d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:47.775408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63336c20-ab51-4cd8-aee2-5f23b6505e9d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:47.779185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f81fa7-a7b7-452c-89fb-e8e47890fc4d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:47.779807 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81fa7-a7b7-452c-89fb-e8e47890fc4d service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:47.780085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81fa7-a7b7-452c-89fb-e8e47890fc4d service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:47.780356 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f81fa7-a7b7-452c-89fb-e8e47890fc4d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:47.790040 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:47.838647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f81fa7-a7b7-452c-89fb-e8e47890fc4d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:47.840090 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f81fa7-a7b7-452c-89fb-e8e47890fc4d service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:47.848779 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1307/2646] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:47 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:43:53.572779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40c3f-c10c-45c6-91c5-2175d7d51cb2 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:53.617127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:53.637329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eb40c3f-c10c-45c6-91c5-2175d7d51cb2 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:53.642319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:53.643181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:53.643466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:53.643741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] PATH_INFO: `/v3/users/c22524b4440d42ce98b09043174b42ab` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:53.645526 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c22524b4440d42ce98b09043174b42ab)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:53.647599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:53.693861 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c22524b4440d42ce98b09043174b42ab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:53.701010 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c22524b4440d42ce98b09043174b42ab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:53.709507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c22524b4440d42ce98b09043174b42ab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:53.721520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c22524b4440d42ce98b09043174b42ab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:53.722251 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c22524b4440d42ce98b09043174b42ab'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:53.728184 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1340/2647] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:53 2022] DELETE /identity/v3/users/c22524b4440d42ce98b09043174b42ab => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:53.732967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2032098-8c69-4f0a-a5c0-40a0f8572b83 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:53.733625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2032098-8c69-4f0a-a5c0-40a0f8572b83 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:53.733625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2032098-8c69-4f0a-a5c0-40a0f8572b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:53.750021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-b2032098-8c69-4f0a-a5c0-40a0f8572b83 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:53.751208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2032098-8c69-4f0a-a5c0-40a0f8572b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:53.811172 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1308/2648] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:53.822457 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:53.824000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:53.883676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33338a98-de7e-4b0b-bb7e-4d1fe34f8e27 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:53.887293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16a022-7b3e-4799-94bb-ebf70bfb9641 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:53.887927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a022-7b3e-4799-94bb-ebf70bfb9641 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:53.888203 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a022-7b3e-4799-94bb-ebf70bfb9641 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:53.888472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e16a022-7b3e-4799-94bb-ebf70bfb9641 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:53.898519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16a022-7b3e-4799-94bb-ebf70bfb9641 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:53.900333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e16a022-7b3e-4799-94bb-ebf70bfb9641 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:53.911941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1341/2649] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:54.192141 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2032098-8c69-4f0a-a5c0-40a0f8572b83 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:54.193970 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b2032098-8c69-4f0a-a5c0-40a0f8572b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:54.206501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2032098-8c69-4f0a-a5c0-40a0f8572b83 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:54.213300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:54.214228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:54.214509 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:54.214783 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] PATH_INFO: `/v3/projects/a06e21b7dad545d9b5aa27370a3d16de` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:54.215963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a06e21b7dad545d9b5aa27370a3d16de)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:54.217907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:54.266962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a06e21b7dad545d9b5aa27370a3d16de', 'request_id': 'req-f7087780-38a0-436f-ad8c-779853a4e900'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.272587 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a06e21b7dad545d9b5aa27370a3d16de', 'request_id': 'req-f7087780-38a0-436f-ad8c-779853a4e900'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.280153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a06e21b7dad545d9b5aa27370a3d16de', 'request_id': 'req-f7087780-38a0-436f-ad8c-779853a4e900'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.290872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] The token cache is being invalidate because project a06e21b7dad545d9b5aa27370a3d16de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:54.291157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.291788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.293307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1309/2650] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:54 2022] DELETE /identity/v3/projects/a06e21b7dad545d9b5aa27370a3d16de => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:54.297281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16a022-7b3e-4799-94bb-ebf70bfb9641 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:54.307911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e16a022-7b3e-4799-94bb-ebf70bfb9641 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:54.362376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:54.363234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:54.364116 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:54.364398 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] PATH_INFO: `/v3/users/e1ed95de2f77482083a7c9b2d07ae2ff` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:54.365591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e1ed95de2f77482083a7c9b2d07ae2ff)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:54.367495 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:54.371916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:54.421711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e1ed95de2f77482083a7c9b2d07ae2ff'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.430750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e1ed95de2f77482083a7c9b2d07ae2ff'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.444507 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e1ed95de2f77482083a7c9b2d07ae2ff'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.460140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e1ed95de2f77482083a7c9b2d07ae2ff'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.461170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c52ce8c7-67ed-45e9-982c-2695cb5cf8f1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e1ed95de2f77482083a7c9b2d07ae2ff'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.470748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1342/2651] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:43:54 2022] DELETE /identity/v3/users/e1ed95de2f77482083a7c9b2d07ae2ff => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:54.774734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:54.776181 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:54.790303 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7087780-38a0-436f-ad8c-779853a4e900 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:54.823809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:54.851044 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:54.851898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:54.852177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:54.852444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] PATH_INFO: `/v3/projects/414a5f12fdaf4b748e09b034a49327a0` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:54.853649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=414a5f12fdaf4b748e09b034a49327a0)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:54.855538 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:54.902832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '414a5f12fdaf4b748e09b034a49327a0', 'request_id': 'req-89e4608e-2adf-4e5b-ac30-35ecf84239b7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.908318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '414a5f12fdaf4b748e09b034a49327a0', 'request_id': 'req-89e4608e-2adf-4e5b-ac30-35ecf84239b7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.914696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '414a5f12fdaf4b748e09b034a49327a0', 'request_id': 'req-89e4608e-2adf-4e5b-ac30-35ecf84239b7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.925516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] The token cache is being invalidate because project 414a5f12fdaf4b748e09b034a49327a0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:43:54.926314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.927042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-89e4608e-2adf-4e5b-ac30-35ecf84239b7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:43:54.928591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1310/2652] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:43:54 2022] DELETE /identity/v3/projects/414a5f12fdaf4b748e09b034a49327a0 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:54.933563 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9311-792d-448d-ad02-2f6371417c7e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:54.934068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9311-792d-448d-ad02-2f6371417c7e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:54.934181 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-852a9311-792d-448d-ad02-2f6371417c7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:54.952807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-852a9311-792d-448d-ad02-2f6371417c7e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:54.954144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-852a9311-792d-448d-ad02-2f6371417c7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:55.014567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1343/2653] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:55.022868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193aaae-3859-4f57-948f-842569425979 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.023157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193aaae-3859-4f57-948f-842569425979 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.023438 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4193aaae-3859-4f57-948f-842569425979 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.041872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4193aaae-3859-4f57-948f-842569425979 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:55.043072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4193aaae-3859-4f57-948f-842569425979 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:55.051723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1311/2654] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:55.055742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9311-792d-448d-ad02-2f6371417c7e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.065474 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-852a9311-792d-448d-ad02-2f6371417c7e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.070818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.071460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.071744 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.072018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.072740 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:43:55.073045 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.074701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.086234 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1344/2655] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:43:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:43:55.090366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193aaae-3859-4f57-948f-842569425979 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.100111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4193aaae-3859-4f57-948f-842569425979 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.104561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719bab-c557-4df1-8cf5-edf19ab334d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.105194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719bab-c557-4df1-8cf5-edf19ab334d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.105498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719bab-c557-4df1-8cf5-edf19ab334d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.105770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07719bab-c557-4df1-8cf5-edf19ab334d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.106464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719bab-c557-4df1-8cf5-edf19ab334d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.108338 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07719bab-c557-4df1-8cf5-edf19ab334d6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.135234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1312/2656] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:55 2022] POST /identity/v3/projects => generated 381 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:55.138835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.149835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f67a9e-992b-452a-b733-1bee5bfcae19 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.206357 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214defc-eafa-47ca-ae68-7655a9331c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.207032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214defc-eafa-47ca-ae68-7655a9331c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.207320 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214defc-eafa-47ca-ae68-7655a9331c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.207594 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9214defc-eafa-47ca-ae68-7655a9331c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.208278 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214defc-eafa-47ca-ae68-7655a9331c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.210222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9214defc-eafa-47ca-ae68-7655a9331c87 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.224800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:55.230333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1345/2657] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:55 2022] POST /identity/v3/users => generated 291 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:55.234081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719bab-c557-4df1-8cf5-edf19ab334d6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.245639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07719bab-c557-4df1-8cf5-edf19ab334d6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.250157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a4f36-8228-422b-b3e5-e985663e67ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.250832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4f36-8228-422b-b3e5-e985663e67ed admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.251136 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4f36-8228-422b-b3e5-e985663e67ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.251408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7a4f36-8228-422b-b3e5-e985663e67ed admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.252126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a4f36-8228-422b-b3e5-e985663e67ed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.253748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7a4f36-8228-422b-b3e5-e985663e67ed admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.263955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1313/2658] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:55.267845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214defc-eafa-47ca-ae68-7655a9331c87 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.277824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9214defc-eafa-47ca-ae68-7655a9331c87 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.282366 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec686f9-b959-4d14-8799-88de7467d447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.283011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec686f9-b959-4d14-8799-88de7467d447 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.283293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec686f9-b959-4d14-8799-88de7467d447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.283567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec686f9-b959-4d14-8799-88de7467d447 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.284288 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec686f9-b959-4d14-8799-88de7467d447 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.286442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec686f9-b959-4d14-8799-88de7467d447 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.296103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1346/2659] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:55.300146 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a4f36-8228-422b-b3e5-e985663e67ed admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.310631 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7a4f36-8228-422b-b3e5-e985663e67ed admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.315391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526416-497e-4dce-a02a-8f2c27a4dd24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.316263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526416-497e-4dce-a02a-8f2c27a4dd24 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.317178 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526416-497e-4dce-a02a-8f2c27a4dd24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.317583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81526416-497e-4dce-a02a-8f2c27a4dd24 admin admin] PATH_INFO: `/v3/projects/af3a68fa5f02415b81f48b331c8b8498/users/23a58bfc887e4aca826cce267409b15d/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.331936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81526416-497e-4dce-a02a-8f2c27a4dd24 admin admin] RBAC: Authorizing `identity:create_grant(project_id=af3a68fa5f02415b81f48b331c8b8498, user_id=23a58bfc887e4aca826cce267409b15d, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.335177 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81526416-497e-4dce-a02a-8f2c27a4dd24 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.348227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1314/2660] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:55 2022] PUT /identity/v3/projects/af3a68fa5f02415b81f48b331c8b8498/users/23a58bfc887e4aca826cce267409b15d/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:55.359786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794f016-ff03-4b15-a099-359c50f75daf None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.360080 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794f016-ff03-4b15-a099-359c50f75daf None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.360377 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2794f016-ff03-4b15-a099-359c50f75daf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.386726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-2794f016-ff03-4b15-a099-359c50f75daf None None] MFA Rules not processed for user `23a58bfc887e4aca826cce267409b15d`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:55.387963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2794f016-ff03-4b15-a099-359c50f75daf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:55.457188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1347/2661] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:55.462838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526416-497e-4dce-a02a-8f2c27a4dd24 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.522673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81526416-497e-4dce-a02a-8f2c27a4dd24 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.527398 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc7676-0e00-449a-a674-34c0e3378223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.528043 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc7676-0e00-449a-a674-34c0e3378223 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.528323 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc7676-0e00-449a-a674-34c0e3378223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.528596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cc7676-0e00-449a-a674-34c0e3378223 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.529286 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc7676-0e00-449a-a674-34c0e3378223 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.531209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cc7676-0e00-449a-a674-34c0e3378223 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.535101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:55.560342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1315/2662] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:55 2022] POST /identity/v3/projects => generated 383 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:55.561506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794f016-ff03-4b15-a099-359c50f75daf None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.572807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2794f016-ff03-4b15-a099-359c50f75daf None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.628214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f99aa-90f8-4b4a-9a4c-039bdd981ffd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.628869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f99aa-90f8-4b4a-9a4c-039bdd981ffd admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.629808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f99aa-90f8-4b4a-9a4c-039bdd981ffd admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.630078 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-728f99aa-90f8-4b4a-9a4c-039bdd981ffd admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.630765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f99aa-90f8-4b4a-9a4c-039bdd981ffd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.632669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-728f99aa-90f8-4b4a-9a4c-039bdd981ffd admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.651837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1348/2663] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:55 2022] POST /identity/v3/users => generated 292 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:55.655788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc7676-0e00-449a-a674-34c0e3378223 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.665907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cc7676-0e00-449a-a674-34c0e3378223 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.670592 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590870-2dd1-4e38-a8a4-698a4242376d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.671246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590870-2dd1-4e38-a8a4-698a4242376d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.671556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590870-2dd1-4e38-a8a4-698a4242376d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.671830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da590870-2dd1-4e38-a8a4-698a4242376d admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.672552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da590870-2dd1-4e38-a8a4-698a4242376d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.674252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da590870-2dd1-4e38-a8a4-698a4242376d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.685506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1316/2664] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:55.689282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f99aa-90f8-4b4a-9a4c-039bdd981ffd admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.699985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-728f99aa-90f8-4b4a-9a4c-039bdd981ffd admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.704602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9bdb29-d132-48cf-9239-45d81a1f240a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.705256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bdb29-d132-48cf-9239-45d81a1f240a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.705571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bdb29-d132-48cf-9239-45d81a1f240a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.705846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9bdb29-d132-48cf-9239-45d81a1f240a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.706577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bdb29-d132-48cf-9239-45d81a1f240a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.708163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9bdb29-d132-48cf-9239-45d81a1f240a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.718277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1349/2665] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:55 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:55.722589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590870-2dd1-4e38-a8a4-698a4242376d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:55.733191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da590870-2dd1-4e38-a8a4-698a4242376d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:55.737882 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47854475-3765-4a3c-949d-31afefb316fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:55.739327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47854475-3765-4a3c-949d-31afefb316fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.739717 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47854475-3765-4a3c-949d-31afefb316fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.740001 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47854475-3765-4a3c-949d-31afefb316fe admin admin] PATH_INFO: `/v3/projects/d3ab16f2d7f74f87b3022a4073b42456/users/1b29109e3ca84bf2aef65503aad64bbb/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.758805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47854475-3765-4a3c-949d-31afefb316fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=d3ab16f2d7f74f87b3022a4073b42456, user_id=1b29109e3ca84bf2aef65503aad64bbb, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:55.762165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47854475-3765-4a3c-949d-31afefb316fe admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:55.782273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1317/2666] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:55 2022] PUT /identity/v3/projects/d3ab16f2d7f74f87b3022a4073b42456/users/1b29109e3ca84bf2aef65503aad64bbb/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:55.800107 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239798-d260-4707-a966-e0dcb666603a None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:55.800394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239798-d260-4707-a966-e0dcb666603a None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:55.800674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab239798-d260-4707-a966-e0dcb666603a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:55.837679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-ab239798-d260-4707-a966-e0dcb666603a None None] MFA Rules not processed for user `1b29109e3ca84bf2aef65503aad64bbb`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:55.839275 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-ab239798-d260-4707-a966-e0dcb666603a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:55.895416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:55.922153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1350/2667] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:55 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:43:55.927202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47854475-3765-4a3c-949d-31afefb316fe admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:56.000268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47854475-3765-4a3c-949d-31afefb316fe admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:56.006604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ef0fc-8778-4809-8f52-0c43f84fc82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:56.007312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ef0fc-8778-4809-8f52-0c43f84fc82a admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:56.007644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ef0fc-8778-4809-8f52-0c43f84fc82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:56.007918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1ef0fc-8778-4809-8f52-0c43f84fc82a admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:56.008739 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ef0fc-8778-4809-8f52-0c43f84fc82a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:56.010771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1ef0fc-8778-4809-8f52-0c43f84fc82a admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:56.041213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1318/2668] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:43:55 2022] POST /identity/v3/projects => generated 383 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:43:56.044979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab239798-d260-4707-a966-e0dcb666603a None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:56.058731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab239798-d260-4707-a966-e0dcb666603a None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:56.162068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bc49a-f062-4cf6-af1c-b91e2e211770 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:56.162907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bc49a-f062-4cf6-af1c-b91e2e211770 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:56.163356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bc49a-f062-4cf6-af1c-b91e2e211770 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:56.163702 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-239bc49a-f062-4cf6-af1c-b91e2e211770 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:56.164417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bc49a-f062-4cf6-af1c-b91e2e211770 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:56.166385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-239bc49a-f062-4cf6-af1c-b91e2e211770 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:56.197432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1351/2669] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:43:56 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:43:56.203487 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ef0fc-8778-4809-8f52-0c43f84fc82a admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:56.216560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1ef0fc-8778-4809-8f52-0c43f84fc82a admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:56.222197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b56475-ec0c-4ef9-843f-37f50c4abe9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:56.223528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b56475-ec0c-4ef9-843f-37f50c4abe9f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:56.223842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b56475-ec0c-4ef9-843f-37f50c4abe9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:56.224108 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b56475-ec0c-4ef9-843f-37f50c4abe9f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:56.224834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b56475-ec0c-4ef9-843f-37f50c4abe9f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:56.226976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b56475-ec0c-4ef9-843f-37f50c4abe9f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:56.241506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1319/2670] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:56.243680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bc49a-f062-4cf6-af1c-b91e2e211770 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:56.254864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-239bc49a-f062-4cf6-af1c-b91e2e211770 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:56.259777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff770-1b38-4f69-9d6b-59f197b6a477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:56.260666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff770-1b38-4f69-9d6b-59f197b6a477 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:56.260993 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff770-1b38-4f69-9d6b-59f197b6a477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:56.261313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aff770-1b38-4f69-9d6b-59f197b6a477 admin admin] PATH_INFO: `/v3/projects/53ae3d7217614e7c853107fcf24dd834/users/e25a0f15ebff49ba96beb9aa8c177392/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:56.279965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff770-1b38-4f69-9d6b-59f197b6a477 admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ae3d7217614e7c853107fcf24dd834, user_id=e25a0f15ebff49ba96beb9aa8c177392, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:56.282705 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aff770-1b38-4f69-9d6b-59f197b6a477 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:56.296904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1352/2671] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:56 2022] PUT /identity/v3/projects/53ae3d7217614e7c853107fcf24dd834/users/e25a0f15ebff49ba96beb9aa8c177392/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:43:56.300945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b56475-ec0c-4ef9-843f-37f50c4abe9f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:56.311606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b56475-ec0c-4ef9-843f-37f50c4abe9f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:56.368455 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b16c3abb-dfa2-4ae2-98dd-09b5e7771e90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:56.369218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3abb-dfa2-4ae2-98dd-09b5e7771e90 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:56.369535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3abb-dfa2-4ae2-98dd-09b5e7771e90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:56.369810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b16c3abb-dfa2-4ae2-98dd-09b5e7771e90 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:56.370523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c3abb-dfa2-4ae2-98dd-09b5e7771e90 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:56.372103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b16c3abb-dfa2-4ae2-98dd-09b5e7771e90 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:56.381724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1320/2672] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:43:56 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:43:56.385978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff770-1b38-4f69-9d6b-59f197b6a477 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:56.396969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aff770-1b38-4f69-9d6b-59f197b6a477 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:56.403138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:56.404008 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:56.404287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:56.404604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] PATH_INFO: `/v3/projects/53ae3d7217614e7c853107fcf24dd834/users/e25a0f15ebff49ba96beb9aa8c177392/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:56.406843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] RBAC: Authorizing `identity:create_grant(project_id=53ae3d7217614e7c853107fcf24dd834, user_id=e25a0f15ebff49ba96beb9aa8c177392, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:56.416204 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:56.423523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1353/2673] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:43:56 2022] PUT /identity/v3/projects/53ae3d7217614e7c853107fcf24dd834/users/e25a0f15ebff49ba96beb9aa8c177392/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:43:56.434270 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094da04-3f69-4bc6-ac45-e858463e9939 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:56.434560 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094da04-3f69-4bc6-ac45-e858463e9939 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:56.434834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c094da04-3f69-4bc6-ac45-e858463e9939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:56.461103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c094da04-3f69-4bc6-ac45-e858463e9939 None None] MFA Rules not processed for user `e25a0f15ebff49ba96beb9aa8c177392`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:43:56.462325 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c094da04-3f69-4bc6-ac45-e858463e9939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:56.471327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:56.532977 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1321/2674] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:43:56 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:43:56.545472 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:56.547258 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:56.604459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a780ea03-ac4a-452d-b586-14c9de28762a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:56.608248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f824-aee8-4167-87f0-cec051b5624c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:56.608884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f824-aee8-4167-87f0-cec051b5624c service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:56.609161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f824-aee8-4167-87f0-cec051b5624c service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:56.609460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379f824-aee8-4167-87f0-cec051b5624c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:56.666186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:43:56.670683 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379f824-aee8-4167-87f0-cec051b5624c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:56.673060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379f824-aee8-4167-87f0-cec051b5624c service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:56.684565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1354/2675] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:56 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:58.193253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094da04-3f69-4bc6-ac45-e858463e9939 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:58.194711 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c094da04-3f69-4bc6-ac45-e858463e9939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:43:58.206273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c094da04-3f69-4bc6-ac45-e858463e9939 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:58.209823 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc09a-4788-4090-bac9-d8cf346840a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:58.210451 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc09a-4788-4090-bac9-d8cf346840a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:58.210733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc09a-4788-4090-bac9-d8cf346840a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:58.211007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc5cc09a-4788-4090-bac9-d8cf346840a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:58.271884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc09a-4788-4090-bac9-d8cf346840a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:58.273241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc5cc09a-4788-4090-bac9-d8cf346840a9 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:58.282395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1322/2676] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:58 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:43:59.682601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f824-aee8-4167-87f0-cec051b5624c service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:43:59.691077 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379f824-aee8-4167-87f0-cec051b5624c service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:43:59.696144 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec8c703-871f-44cb-806e-bdc1b7677e6c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:43:59.696814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c703-871f-44cb-806e-bdc1b7677e6c service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:43:59.697264 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c703-871f-44cb-806e-bdc1b7677e6c service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:43:59.697578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec8c703-871f-44cb-806e-bdc1b7677e6c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:43:59.709466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8c703-871f-44cb-806e-bdc1b7677e6c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:43:59.710929 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec8c703-871f-44cb-806e-bdc1b7677e6c service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:43:59.720911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1355/2677] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:43:59 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:03.565094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc09a-4788-4090-bac9-d8cf346840a9 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:03.627238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc5cc09a-4788-4090-bac9-d8cf346840a9 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:03.632278 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:03.633135 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:03.633411 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:03.633705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] PATH_INFO: `/v3/users/23a58bfc887e4aca826cce267409b15d` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:03.634862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] RBAC: Authorizing `identity:delete_user(user_id=23a58bfc887e4aca826cce267409b15d)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:03.636789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:03.683647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '23a58bfc887e4aca826cce267409b15d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:03.684651 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:03.697529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '23a58bfc887e4aca826cce267409b15d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:03.704383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '23a58bfc887e4aca826cce267409b15d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:03.711706 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '23a58bfc887e4aca826cce267409b15d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:03.712329 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '23a58bfc887e4aca826cce267409b15d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:03.718361 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1323/2678] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:03 2022] DELETE /identity/v3/users/23a58bfc887e4aca826cce267409b15d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:03.723292 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660093a-b868-4cb9-8ae1-6a8ac7746ed0 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:03.723778 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660093a-b868-4cb9-8ae1-6a8ac7746ed0 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:03.723876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5660093a-b868-4cb9-8ae1-6a8ac7746ed0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:03.741629 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5660093a-b868-4cb9-8ae1-6a8ac7746ed0 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:03.742839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5660093a-b868-4cb9-8ae1-6a8ac7746ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:03.804447 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1356/2679] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:03.814148 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:03.815531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:03.873676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e108b68b-10ed-4d3e-abbe-f04909d4f036 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:03.878091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f74de-6b82-4334-90b4-2308ab355ff3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:03.879546 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f74de-6b82-4334-90b4-2308ab355ff3 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:03.879948 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f74de-6b82-4334-90b4-2308ab355ff3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:03.880296 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7f74de-6b82-4334-90b4-2308ab355ff3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:03.890299 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f74de-6b82-4334-90b4-2308ab355ff3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:03.891742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e7f74de-6b82-4334-90b4-2308ab355ff3 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:03.901963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1324/2680] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:04.177012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660093a-b868-4cb9-8ae1-6a8ac7746ed0 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:04.178572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5660093a-b868-4cb9-8ae1-6a8ac7746ed0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:04.202425 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5660093a-b868-4cb9-8ae1-6a8ac7746ed0 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:04.209510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:04.210575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:04.210925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:04.211297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] PATH_INFO: `/v3/projects/af3a68fa5f02415b81f48b331c8b8498` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:04.212565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] RBAC: Authorizing `identity:delete_project(project_id=af3a68fa5f02415b81f48b331c8b8498)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:04.214650 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:04.271719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'af3a68fa5f02415b81f48b331c8b8498', 'request_id': 'req-c64c0a1b-ec55-4d64-9889-5aecb19dd309'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.279400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'af3a68fa5f02415b81f48b331c8b8498', 'request_id': 'req-c64c0a1b-ec55-4d64-9889-5aecb19dd309'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.289656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'af3a68fa5f02415b81f48b331c8b8498', 'request_id': 'req-c64c0a1b-ec55-4d64-9889-5aecb19dd309'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.304681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] The token cache is being invalidate because project af3a68fa5f02415b81f48b331c8b8498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:04.305052 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.305637 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.307210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1357/2681] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:04 2022] DELETE /identity/v3/projects/af3a68fa5f02415b81f48b331c8b8498 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:04.311191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f74de-6b82-4334-90b4-2308ab355ff3 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:04.321201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7f74de-6b82-4334-90b4-2308ab355ff3 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:04.389400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:04.390292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:04.390571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:04.390841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] PATH_INFO: `/v3/users/1b29109e3ca84bf2aef65503aad64bbb` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:04.394910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1b29109e3ca84bf2aef65503aad64bbb)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:04.396942 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:04.462427 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1b29109e3ca84bf2aef65503aad64bbb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.476606 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1b29109e3ca84bf2aef65503aad64bbb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.481561 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:04.484834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1b29109e3ca84bf2aef65503aad64bbb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.499639 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1b29109e3ca84bf2aef65503aad64bbb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.500488 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1b29109e3ca84bf2aef65503aad64bbb'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.507709 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1325/2682] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:04 2022] DELETE /identity/v3/users/1b29109e3ca84bf2aef65503aad64bbb => generated 0 bytes in 197 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:04.601026 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:04.603156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:04.619522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c64c0a1b-ec55-4d64-9889-5aecb19dd309 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:04.702083 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:04.702967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:04.703259 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:04.703527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] PATH_INFO: `/v3/users/1dce1ffaffb44d27a40960b4cba340bc` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:04.704706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] RBAC: Authorizing `identity:delete_user(user_id=1dce1ffaffb44d27a40960b4cba340bc)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:04.706649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:04.713884 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:04.768831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1dce1ffaffb44d27a40960b4cba340bc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.777785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1dce1ffaffb44d27a40960b4cba340bc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.784962 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1dce1ffaffb44d27a40960b4cba340bc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.797654 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1dce1ffaffb44d27a40960b4cba340bc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.798406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-27eaa782-3b93-47a0-aed4-4aaba6bf000c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1dce1ffaffb44d27a40960b4cba340bc'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.804533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:04.806106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:04.809269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1358/2683] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:04 2022] DELETE /identity/v3/users/1dce1ffaffb44d27a40960b4cba340bc => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:04.810815 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21cf1-b7e7-4f4f-9195-9b9899e95192 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:04.811170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21cf1-b7e7-4f4f-9195-9b9899e95192 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:04.811512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ce21cf1-b7e7-4f4f-9195-9b9899e95192 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:04.828203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02521dfc-911d-46cd-8337-9d02478b77d8 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:04.832360 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5ce21cf1-b7e7-4f4f-9195-9b9899e95192 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:04.834242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5ce21cf1-b7e7-4f4f-9195-9b9899e95192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:04.897965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1359/2684] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:04.902170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:04.903117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:04.903495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:04.903868 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] PATH_INFO: `/v3/projects/d3ab16f2d7f74f87b3022a4073b42456` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:04.905151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=d3ab16f2d7f74f87b3022a4073b42456)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:04.907441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:04.907834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21cf1-b7e7-4f4f-9195-9b9899e95192 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:04.909164 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5ce21cf1-b7e7-4f4f-9195-9b9899e95192 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:04.957897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd3ab16f2d7f74f87b3022a4073b42456', 'request_id': 'req-29bd0583-274a-4ef5-a840-9359cceb73ae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.963598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd3ab16f2d7f74f87b3022a4073b42456', 'request_id': 'req-29bd0583-274a-4ef5-a840-9359cceb73ae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.969818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ce21cf1-b7e7-4f4f-9195-9b9899e95192 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:04.970347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd3ab16f2d7f74f87b3022a4073b42456', 'request_id': 'req-29bd0583-274a-4ef5-a840-9359cceb73ae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.981930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] The token cache is being invalidate because project d3ab16f2d7f74f87b3022a4073b42456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:04.982209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.982828 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:04.984341 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1326/2685] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:04 2022] DELETE /identity/v3/projects/d3ab16f2d7f74f87b3022a4073b42456 => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:44:04.988790 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:04.990194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:05.008349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:05.022487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:05.023489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:05.024095 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:05.024407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:05.026717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:05.060137 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bd0583-274a-4ef5-a840-9359cceb73ae admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:05.065719 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:05.067282 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:05.067635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:05.067973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] PATH_INFO: `/v3/users/e25a0f15ebff49ba96beb9aa8c177392` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:05.069578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e25a0f15ebff49ba96beb9aa8c177392)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:05.071973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:05.091609 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:05.093954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:05.098791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:05.107188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1360/2686] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 200 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:44:05.131482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e25a0f15ebff49ba96beb9aa8c177392'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.144466 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e25a0f15ebff49ba96beb9aa8c177392'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.151645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e25a0f15ebff49ba96beb9aa8c177392'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.158697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e25a0f15ebff49ba96beb9aa8c177392'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.159331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e25a0f15ebff49ba96beb9aa8c177392'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.166102 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1327/2687] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:04 2022] DELETE /identity/v3/users/e25a0f15ebff49ba96beb9aa8c177392 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:05.469467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:05.470886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:05.483428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7240bcf-87f6-4f52-9a71-974035b322ba service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:05.530967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:05.532676 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:05.560525 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:05.561691 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:05.562068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:05.562463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] PATH_INFO: `/v3/projects/06b773ab4e4d4760af93d81435845e40` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:05.563869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=06b773ab4e4d4760af93d81435845e40)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:05.565969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:05.610066 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795deaa2-2c90-430e-87b4-f07153251eb7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:05.621021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06b773ab4e4d4760af93d81435845e40', 'request_id': 'req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.629569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06b773ab4e4d4760af93d81435845e40', 'request_id': 'req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.637880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06b773ab4e4d4760af93d81435845e40', 'request_id': 'req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.649235 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] The token cache is being invalidate because project 06b773ab4e4d4760af93d81435845e40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:05.649554 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.650182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.651987 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1361/2688] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:05 2022] DELETE /identity/v3/projects/06b773ab4e4d4760af93d81435845e40 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:05.655680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:05.657098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:05.675192 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:05.676745 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:05.677234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:05.677618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] PATH_INFO: `/v3/projects/53ae3d7217614e7c853107fcf24dd834` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:05.679009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] RBAC: Authorizing `identity:delete_project(project_id=53ae3d7217614e7c853107fcf24dd834)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:05.681017 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:05.684469 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:05.739934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=11,keystone:SELECT=88,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:05.742730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '53ae3d7217614e7c853107fcf24dd834', 'request_id': 'req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.746972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf96cabb-3760-44d9-ba2f-8c9d326f0dc1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:05.748870 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '53ae3d7217614e7c853107fcf24dd834', 'request_id': 'req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.757852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '53ae3d7217614e7c853107fcf24dd834', 'request_id': 'req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.768870 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] The token cache is being invalidate because project 53ae3d7217614e7c853107fcf24dd834 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:05.769285 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.770005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-96ce3bf0-33d7-43ba-b74b-495f2272cd4e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.771547 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1328/2689] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:05 2022] DELETE /identity/v3/projects/53ae3d7217614e7c853107fcf24dd834 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:44:05.776598 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b9b16-5866-4b76-858b-376278fe1db8 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:05.776908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b9b16-5866-4b76-858b-376278fe1db8 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:05.777180 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b9b16-5866-4b76-858b-376278fe1db8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:05.795023 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-cb7b9b16-5866-4b76-858b-376278fe1db8 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:05.796226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-cb7b9b16-5866-4b76-858b-376278fe1db8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:05.809948 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:05.811486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:05.811784 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:05.812085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] PATH_INFO: `/v3/users/f3a731c70b974f7a9e63f682513fd198` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:05.813652 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] RBAC: Authorizing `identity:delete_user(user_id=f3a731c70b974f7a9e63f682513fd198)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:05.815745 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:05.860416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1329/2690] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:05.867027 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f3a731c70b974f7a9e63f682513fd198'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.870185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e010-3a7d-42b7-877e-95f7a8280d34 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:05.870473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e010-3a7d-42b7-877e-95f7a8280d34 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:05.870744 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c15e010-3a7d-42b7-877e-95f7a8280d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:05.880023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f3a731c70b974f7a9e63f682513fd198'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.887950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f3a731c70b974f7a9e63f682513fd198'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.890096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-4c15e010-3a7d-42b7-877e-95f7a8280d34 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:05.891307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-4c15e010-3a7d-42b7-877e-95f7a8280d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:05.899962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1330/2691] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:05.900704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f3a731c70b974f7a9e63f682513fd198'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.901659 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f3a731c70b974f7a9e63f682513fd198'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:05.904260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e010-3a7d-42b7-877e-95f7a8280d34 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:05.907805 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1362/2692] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:05 2022] DELETE /identity/v3/users/f3a731c70b974f7a9e63f682513fd198 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:05.919522 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c15e010-3a7d-42b7-877e-95f7a8280d34 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:05.980636 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:05.981395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:05.981770 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:05.982113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:05.982907 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:44:05.983284 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:05.984955 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.000245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1331/2693] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:44:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:44:06.001410 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.002840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:06.016098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04474b17-8769-4eb4-bf04-1ae7f935a45e admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.022082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfb0b4-ce19-4f49-93d3-e3e4f7784356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.027496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfb0b4-ce19-4f49-93d3-e3e4f7784356 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.027496 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfb0b4-ce19-4f49-93d3-e3e4f7784356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.027978 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4cfb0b4-ce19-4f49-93d3-e3e4f7784356 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.031335 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfb0b4-ce19-4f49-93d3-e3e4f7784356 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.034498 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4cfb0b4-ce19-4f49-93d3-e3e4f7784356 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.062430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1363/2694] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/projects => generated 389 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:06.067380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.080029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62da5ee4-d7e2-4777-ab6b-0c2ca8efb3f6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.146171 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.147009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.147403 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.148301 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.148591 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.150784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.158973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:DELETE=4,keystone:SELECT=94,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:06.173527 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1332/2695] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/users => generated 295 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:06.178434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfb0b4-ce19-4f49-93d3-e3e4f7784356 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.189033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4cfb0b4-ce19-4f49-93d3-e3e4f7784356 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.194161 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb8883-3011-4325-a7e9-9f4fa1ee3ff8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.194972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb8883-3011-4325-a7e9-9f4fa1ee3ff8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.195119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb8883-3011-4325-a7e9-9f4fa1ee3ff8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.195348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acdb8883-3011-4325-a7e9-9f4fa1ee3ff8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.196074 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb8883-3011-4325-a7e9-9f4fa1ee3ff8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.197956 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acdb8883-3011-4325-a7e9-9f4fa1ee3ff8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.210934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.211143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1364/2696] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:06.214721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb8883-3011-4325-a7e9-9f4fa1ee3ff8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.215262 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:06.226329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acdb8883-3011-4325-a7e9-9f4fa1ee3ff8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.231005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab359ba-fd52-4df4-8d55-37063620c831 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.231799 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab359ba-fd52-4df4-8d55-37063620c831 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.232081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab359ba-fd52-4df4-8d55-37063620c831 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.232350 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab359ba-fd52-4df4-8d55-37063620c831 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.233094 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab359ba-fd52-4df4-8d55-37063620c831 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.233703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ed7f7-c377-43dc-9bcd-d7d33b80604b admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.234726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab359ba-fd52-4df4-8d55-37063620c831 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.240153 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.241075 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.241556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.241871 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] PATH_INFO: `/v3/projects/45bff6f6029546c283910ef910002b26` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.243440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=45bff6f6029546c283910ef910002b26)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.245810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.246568 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1365/2697] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:44:06.250375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab359ba-fd52-4df4-8d55-37063620c831 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.256274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:06.263306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab359ba-fd52-4df4-8d55-37063620c831 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.270193 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68bad696-3012-4afe-bb66-fecfc2a626c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.271069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad696-3012-4afe-bb66-fecfc2a626c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.271353 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad696-3012-4afe-bb66-fecfc2a626c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.271623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68bad696-3012-4afe-bb66-fecfc2a626c9 admin admin] PATH_INFO: `/v3/projects/3200c7ba418d4a4dbafb8d2a43b6e9c7/users/99716f99ae6c48139bb6cd1f39d73222/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.289188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bad696-3012-4afe-bb66-fecfc2a626c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3200c7ba418d4a4dbafb8d2a43b6e9c7, user_id=99716f99ae6c48139bb6cd1f39d73222, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.291876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68bad696-3012-4afe-bb66-fecfc2a626c9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.304597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '45bff6f6029546c283910ef910002b26', 'request_id': 'req-200751df-6ccd-401b-afe7-6b1d421edb7b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:06.304896 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1366/2698] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:06 2022] PUT /identity/v3/projects/3200c7ba418d4a4dbafb8d2a43b6e9c7/users/99716f99ae6c48139bb6cd1f39d73222/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:44:06.310314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '45bff6f6029546c283910ef910002b26', 'request_id': 'req-200751df-6ccd-401b-afe7-6b1d421edb7b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:06.314936 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aba67-23c3-45dd-bb3b-4254613def5e None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.315221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aba67-23c3-45dd-bb3b-4254613def5e None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.315585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1aba67-23c3-45dd-bb3b-4254613def5e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.318156 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '45bff6f6029546c283910ef910002b26', 'request_id': 'req-200751df-6ccd-401b-afe7-6b1d421edb7b'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:06.329930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] The token cache is being invalidate because project 45bff6f6029546c283910ef910002b26 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:06.330211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:06.330855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-200751df-6ccd-401b-afe7-6b1d421edb7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:06.333079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1333/2699] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:06 2022] DELETE /identity/v3/projects/45bff6f6029546c283910ef910002b26 => generated 0 bytes in 123 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:06.337693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a7be-79fe-48a3-b5eb-8f4b7e737ce4 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.337978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a7be-79fe-48a3-b5eb-8f4b7e737ce4 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.338255 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc8a7be-79fe-48a3-b5eb-8f4b7e737ce4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.346039 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5d1aba67-23c3-45dd-bb3b-4254613def5e None None] MFA Rules not processed for user `99716f99ae6c48139bb6cd1f39d73222`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:06.347359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d1aba67-23c3-45dd-bb3b-4254613def5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:06.356037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9cc8a7be-79fe-48a3-b5eb-8f4b7e737ce4 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:06.357213 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9cc8a7be-79fe-48a3-b5eb-8f4b7e737ce4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:06.429623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1334/2700] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:06.433146 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1367/2701] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:06.438543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac6356-99c1-462a-b54a-6af6a6d3f3a5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.438543 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac6356-99c1-462a-b54a-6af6a6d3f3a5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.438804 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fac6356-99c1-462a-b54a-6af6a6d3f3a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.444570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aba67-23c3-45dd-bb3b-4254613def5e None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.446213 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5d1aba67-23c3-45dd-bb3b-4254613def5e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:06.460117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9fac6356-99c1-462a-b54a-6af6a6d3f3a5 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:06.461343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9fac6356-99c1-462a-b54a-6af6a6d3f3a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:06.469183 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1335/2702] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:06.473462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac6356-99c1-462a-b54a-6af6a6d3f3a5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.482962 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fac6356-99c1-462a-b54a-6af6a6d3f3a5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.487762 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.488513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.488801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.489076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.489834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:44:06.490150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.491751 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.504257 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1336/2703] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:44:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:44:06.508418 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.509975 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1aba67-23c3-45dd-bb3b-4254613def5e None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.513937 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474385-c6e0-4c80-94bd-3dd772cfeb1f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.514663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474385-c6e0-4c80-94bd-3dd772cfeb1f service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.514945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474385-c6e0-4c80-94bd-3dd772cfeb1f service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.515219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06474385-c6e0-4c80-94bd-3dd772cfeb1f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.518190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2032cfb-2df2-4916-b243-77df6ce5ec44 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.527909 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06474385-c6e0-4c80-94bd-3dd772cfeb1f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.529327 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06474385-c6e0-4c80-94bd-3dd772cfeb1f service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.530057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747c010-e168-4687-8d97-4efaba5df2f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.530732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747c010-e168-4687-8d97-4efaba5df2f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.531199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747c010-e168-4687-8d97-4efaba5df2f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.531514 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f747c010-e168-4687-8d97-4efaba5df2f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.532237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747c010-e168-4687-8d97-4efaba5df2f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.534203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f747c010-e168-4687-8d97-4efaba5df2f7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.539118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1368/2704] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:06 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:44:06.563734 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1337/2705] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/projects => generated 355 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:44:06.565037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474385-c6e0-4c80-94bd-3dd772cfeb1f service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.576627 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06474385-c6e0-4c80-94bd-3dd772cfeb1f service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.642091 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a72fd-4f23-424a-aac5-67fc31cac6b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.642766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a72fd-4f23-424a-aac5-67fc31cac6b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.643051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a72fd-4f23-424a-aac5-67fc31cac6b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.643323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947a72fd-4f23-424a-aac5-67fc31cac6b6 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.644018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a72fd-4f23-424a-aac5-67fc31cac6b6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.646351 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947a72fd-4f23-424a-aac5-67fc31cac6b6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.662272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:06.668362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1369/2706] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/users => generated 278 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:06.672155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747c010-e168-4687-8d97-4efaba5df2f7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.684239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f747c010-e168-4687-8d97-4efaba5df2f7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.690193 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16323d-5236-4a83-b2b4-f5422b557289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.690852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16323d-5236-4a83-b2b4-f5422b557289 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.691203 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16323d-5236-4a83-b2b4-f5422b557289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.691492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a16323d-5236-4a83-b2b4-f5422b557289 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.692502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16323d-5236-4a83-b2b4-f5422b557289 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.694239 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a16323d-5236-4a83-b2b4-f5422b557289 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.707483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1338/2707] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:06.712076 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a72fd-4f23-424a-aac5-67fc31cac6b6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.726206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947a72fd-4f23-424a-aac5-67fc31cac6b6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.731185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-173ba8c6-1b1d-4ffc-b339-d6b800e6987a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.731965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba8c6-1b1d-4ffc-b339-d6b800e6987a admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.732371 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba8c6-1b1d-4ffc-b339-d6b800e6987a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.732751 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-173ba8c6-1b1d-4ffc-b339-d6b800e6987a admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.733618 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ba8c6-1b1d-4ffc-b339-d6b800e6987a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.735514 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-173ba8c6-1b1d-4ffc-b339-d6b800e6987a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.747626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1370/2708] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:06 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:06.751829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16323d-5236-4a83-b2b4-f5422b557289 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:06.770061 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a16323d-5236-4a83-b2b4-f5422b557289 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:06.776772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa225d8-c405-416b-8a90-b67602c369ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:06.777911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa225d8-c405-416b-8a90-b67602c369ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.778263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa225d8-c405-416b-8a90-b67602c369ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.778627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa225d8-c405-416b-8a90-b67602c369ab admin admin] PATH_INFO: `/v3/projects/9b9761bf0b4549189ba06d94888c7440/users/2d19d18dc08148088c7f916a0ce5caf0/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.795842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa225d8-c405-416b-8a90-b67602c369ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=9b9761bf0b4549189ba06d94888c7440, user_id=2d19d18dc08148088c7f916a0ce5caf0, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:06.798645 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa225d8-c405-416b-8a90-b67602c369ab admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:06.820327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:INSERT=5,keystone:SELECT=88,keystone:DELETE=7 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:06.827273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1339/2709] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:06 2022] PUT /identity/v3/projects/9b9761bf0b4549189ba06d94888c7440/users/2d19d18dc08148088c7f916a0ce5caf0/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:44:06.837939 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3b2d-1419-429a-89e9-a1ecbe45ed21 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:06.838453 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3b2d-1419-429a-89e9-a1ecbe45ed21 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:06.838622 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-781c3b2d-1419-429a-89e9-a1ecbe45ed21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:06.868184 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-781c3b2d-1419-429a-89e9-a1ecbe45ed21 None None] MFA Rules not processed for user `2d19d18dc08148088c7f916a0ce5caf0`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:06.869669 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-781c3b2d-1419-429a-89e9-a1ecbe45ed21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:06.942819 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1371/2710] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:06.947313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa225d8-c405-416b-8a90-b67602c369ab admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:07.008541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa225d8-c405-416b-8a90-b67602c369ab admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:07.013127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592cfd3-e257-4ea5-bec3-fc10335a961d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:07.013831 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592cfd3-e257-4ea5-bec3-fc10335a961d admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.014115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592cfd3-e257-4ea5-bec3-fc10335a961d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.014395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592cfd3-e257-4ea5-bec3-fc10335a961d admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.015076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592cfd3-e257-4ea5-bec3-fc10335a961d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:07.016979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9592cfd3-e257-4ea5-bec3-fc10335a961d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:07.041057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1340/2711] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:44:06 2022] POST /identity/v3/projects => generated 357 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:44:07.045267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3b2d-1419-429a-89e9-a1ecbe45ed21 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:07.056600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-781c3b2d-1419-429a-89e9-a1ecbe45ed21 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:07.111635 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f35897-36f2-4e64-8b8f-081ecb559c23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:07.112202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35897-36f2-4e64-8b8f-081ecb559c23 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.112478 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35897-36f2-4e64-8b8f-081ecb559c23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.112747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f35897-36f2-4e64-8b8f-081ecb559c23 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.114041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f35897-36f2-4e64-8b8f-081ecb559c23 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:07.115940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04f35897-36f2-4e64-8b8f-081ecb559c23 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:07.135294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1372/2712] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:44:07 2022] POST /identity/v3/users => generated 285 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:07.139461 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592cfd3-e257-4ea5-bec3-fc10335a961d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:07.149486 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592cfd3-e257-4ea5-bec3-fc10335a961d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:07.154256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679a767-efb8-446d-899e-df48011f63f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:07.154898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a767-efb8-446d-899e-df48011f63f4 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.155176 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a767-efb8-446d-899e-df48011f63f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.155448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2679a767-efb8-446d-899e-df48011f63f4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.156164 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679a767-efb8-446d-899e-df48011f63f4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:07.157769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2679a767-efb8-446d-899e-df48011f63f4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:07.168480 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1341/2713] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:07.172450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f35897-36f2-4e64-8b8f-081ecb559c23 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:07.182999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f35897-36f2-4e64-8b8f-081ecb559c23 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:07.187567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcf1d6-8b42-4e16-bd6e-9defe41958a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:07.188434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcf1d6-8b42-4e16-bd6e-9defe41958a9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.188712 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcf1d6-8b42-4e16-bd6e-9defe41958a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.188985 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbcf1d6-8b42-4e16-bd6e-9defe41958a9 admin admin] PATH_INFO: `/v3/projects/9ed6b250f981480fb4992706c6da7305/users/2ea78614207d48d2beed3a6d532bc388/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.203923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcf1d6-8b42-4e16-bd6e-9defe41958a9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed6b250f981480fb4992706c6da7305, user_id=2ea78614207d48d2beed3a6d532bc388, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:07.206662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fbcf1d6-8b42-4e16-bd6e-9defe41958a9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:07.219170 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1373/2714] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:07 2022] PUT /identity/v3/projects/9ed6b250f981480fb4992706c6da7305/users/2ea78614207d48d2beed3a6d532bc388/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:07.223829 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679a767-efb8-446d-899e-df48011f63f4 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:07.233772 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2679a767-efb8-446d-899e-df48011f63f4 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:07.291234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9783ca25-11d8-41c9-9c58-2fa58bc81875 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:07.291905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ca25-11d8-41c9-9c58-2fa58bc81875 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.292189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ca25-11d8-41c9-9c58-2fa58bc81875 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.292464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9783ca25-11d8-41c9-9c58-2fa58bc81875 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.293183 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ca25-11d8-41c9-9c58-2fa58bc81875 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:07.294805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9783ca25-11d8-41c9-9c58-2fa58bc81875 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:07.306289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1342/2715] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:07 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:07.311284 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcf1d6-8b42-4e16-bd6e-9defe41958a9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:07.323501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbcf1d6-8b42-4e16-bd6e-9defe41958a9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:07.330246 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3513a3-a6d1-444e-8b51-3ec0d3f2bbd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:07.331201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3513a3-a6d1-444e-8b51-3ec0d3f2bbd6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.331508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3513a3-a6d1-444e-8b51-3ec0d3f2bbd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.331967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3513a3-a6d1-444e-8b51-3ec0d3f2bbd6 admin admin] PATH_INFO: `/v3/projects/9ed6b250f981480fb4992706c6da7305/users/2ea78614207d48d2beed3a6d532bc388/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.334314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3513a3-a6d1-444e-8b51-3ec0d3f2bbd6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9ed6b250f981480fb4992706c6da7305, user_id=2ea78614207d48d2beed3a6d532bc388, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:07.336951 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3513a3-a6d1-444e-8b51-3ec0d3f2bbd6 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:07.348199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1374/2716] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:07 2022] PUT /identity/v3/projects/9ed6b250f981480fb4992706c6da7305/users/2ea78614207d48d2beed3a6d532bc388/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:07.358394 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871665f9-1401-4199-9b1f-9211b47485c0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.358682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871665f9-1401-4199-9b1f-9211b47485c0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.358978 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-871665f9-1401-4199-9b1f-9211b47485c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.385387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-871665f9-1401-4199-9b1f-9211b47485c0 None None] MFA Rules not processed for user `2ea78614207d48d2beed3a6d532bc388`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:07.386534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-871665f9-1401-4199-9b1f-9211b47485c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:07.451954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:07.464074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1343/2717] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:07 2022] POST /identity/v3/auth/tokens => generated 3291 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:07.476619 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3513a3-a6d1-444e-8b51-3ec0d3f2bbd6 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:07.510068 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:07.540681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3513a3-a6d1-444e-8b51-3ec0d3f2bbd6 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:07.544464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:07.545139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.545595 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.545894 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.555813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:07.557282 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:07.567244 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1375/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:07 2022] GET /identity/v3/auth/tokens => generated 3291 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:07.638151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871665f9-1401-4199-9b1f-9211b47485c0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:07.647825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-871665f9-1401-4199-9b1f-9211b47485c0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:07.651671 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9723985-dd91-49e7-a732-b131078c1de7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:07.652300 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723985-dd91-49e7-a732-b131078c1de7 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:07.652582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723985-dd91-49e7-a732-b131078c1de7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:07.652856 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9723985-dd91-49e7-a732-b131078c1de7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:07.708281 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9723985-dd91-49e7-a732-b131078c1de7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:07.709748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9723985-dd91-49e7-a732-b131078c1de7 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:07.719794 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1344/2719] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:07 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:17.562471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=12 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:17.714939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=31 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:25.841192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:25.842803 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:25.905960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef34b15-25d3-4f1a-89ee-5d4e31fc82d1 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:25.910346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:25.911198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:25.911473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:25.911742 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] PATH_INFO: `/v3/users/99716f99ae6c48139bb6cd1f39d73222` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:25.912907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99716f99ae6c48139bb6cd1f39d73222)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:25.915416 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:25.959888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99716f99ae6c48139bb6cd1f39d73222'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:25.967333 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99716f99ae6c48139bb6cd1f39d73222'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:25.973996 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99716f99ae6c48139bb6cd1f39d73222'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:25.986505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99716f99ae6c48139bb6cd1f39d73222'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:25.987227 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99716f99ae6c48139bb6cd1f39d73222'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:25.993838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1376/2720] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:25 2022] DELETE /identity/v3/users/99716f99ae6c48139bb6cd1f39d73222 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:26.001904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22b149-d33b-4932-943d-ccee63138781 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.002374 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22b149-d33b-4932-943d-ccee63138781 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.002484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a22b149-d33b-4932-943d-ccee63138781 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.021792 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6a22b149-d33b-4932-943d-ccee63138781 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:26.023010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6a22b149-d33b-4932-943d-ccee63138781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:26.087812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1345/2721] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:26.097520 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:26.099040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:26.164569 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0196e640-4c56-405c-b5c6-72aa199beb50 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:26.168093 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:26.168741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.169021 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.169287 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.178345 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:26.180312 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:26.189960 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1377/2722] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:26.402936 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22b149-d33b-4932-943d-ccee63138781 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:26.405780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6a22b149-d33b-4932-943d-ccee63138781 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:26.430095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a22b149-d33b-4932-943d-ccee63138781 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:26.435531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:26.436405 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.436686 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.436960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] PATH_INFO: `/v3/users/22bad16daba543c89dabe699b41b24b4` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.438202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] RBAC: Authorizing `identity:delete_user(user_id=22bad16daba543c89dabe699b41b24b4)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:26.440237 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:26.491408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '22bad16daba543c89dabe699b41b24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.502661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:26.504557 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:26.508016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '22bad16daba543c89dabe699b41b24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.517877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '22bad16daba543c89dabe699b41b24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.522038 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f0e86-00c4-4225-b5e6-72a2aab891f4 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:26.527674 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '22bad16daba543c89dabe699b41b24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.528605 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-cccd16d5-9d37-442d-ab10-3c9af18aa361 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '22bad16daba543c89dabe699b41b24b4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.529517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:26.530606 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.530930 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.531151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] PATH_INFO: `/v3/projects/3200c7ba418d4a4dbafb8d2a43b6e9c7` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.532336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3200c7ba418d4a4dbafb8d2a43b6e9c7)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:26.534356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:26.535589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1346/2723] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:26 2022] DELETE /identity/v3/users/22bad16daba543c89dabe699b41b24b4 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:26.540086 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac426e87-ea91-4a66-989f-70d397ef72ea None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.540439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac426e87-ea91-4a66-989f-70d397ef72ea None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.540641 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac426e87-ea91-4a66-989f-70d397ef72ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.555818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:26.557712 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ac426e87-ea91-4a66-989f-70d397ef72ea None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:26.558949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac426e87-ea91-4a66-989f-70d397ef72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:26.587857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3200c7ba418d4a4dbafb8d2a43b6e9c7', 'request_id': 'req-c84681de-0717-432e-9494-ea5568e20de5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.593926 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3200c7ba418d4a4dbafb8d2a43b6e9c7', 'request_id': 'req-c84681de-0717-432e-9494-ea5568e20de5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.602367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3200c7ba418d4a4dbafb8d2a43b6e9c7', 'request_id': 'req-c84681de-0717-432e-9494-ea5568e20de5'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.613103 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] The token cache is being invalidate because project 3200c7ba418d4a4dbafb8d2a43b6e9c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:26.613389 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.614055 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c84681de-0717-432e-9494-ea5568e20de5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:26.615756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1378/2724] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:26 2022] DELETE /identity/v3/projects/3200c7ba418d4a4dbafb8d2a43b6e9c7 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:44:26.620914 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb3d8-c99b-4e78-8d08-b9e644235ee1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.621195 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb3d8-c99b-4e78-8d08-b9e644235ee1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.621490 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40fb3d8-c99b-4e78-8d08-b9e644235ee1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.622245 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1347/2725] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:26.631706 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac426e87-ea91-4a66-989f-70d397ef72ea None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:26.633991 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ac426e87-ea91-4a66-989f-70d397ef72ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:26.641833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e40fb3d8-c99b-4e78-8d08-b9e644235ee1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:26.643108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e40fb3d8-c99b-4e78-8d08-b9e644235ee1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:26.649042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:26.701687 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac426e87-ea91-4a66-989f-70d397ef72ea None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:26.714648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1379/2726] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:26.722468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f09d7-cd94-48bd-af5a-9e41d878d8ef None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.722757 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f09d7-cd94-48bd-af5a-9e41d878d8ef None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.723032 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1f09d7-cd94-48bd-af5a-9e41d878d8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.741273 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-7d1f09d7-cd94-48bd-af5a-9e41d878d8ef None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:26.743221 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7d1f09d7-cd94-48bd-af5a-9e41d878d8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:26.752137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1380/2727] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:26.756847 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f09d7-cd94-48bd-af5a-9e41d878d8ef None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:26.757011 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26d24d-ef5d-4549-9a9b-64c0aa785aa1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:26.758059 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26d24d-ef5d-4549-9a9b-64c0aa785aa1 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.758395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26d24d-ef5d-4549-9a9b-64c0aa785aa1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.758672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc26d24d-ef5d-4549-9a9b-64c0aa785aa1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.767209 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1f09d7-cd94-48bd-af5a-9e41d878d8ef None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:26.768445 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26d24d-ef5d-4549-9a9b-64c0aa785aa1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:26.769929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc26d24d-ef5d-4549-9a9b-64c0aa785aa1 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:26.772518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:26.773200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.773511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.773965 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.774698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:44:26.775005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:26.776865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:26.780370 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1348/2728] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:44:26.790972 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1381/2729] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:44:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:44:26.796584 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26d24d-ef5d-4549-9a9b-64c0aa785aa1 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:26.808310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc26d24d-ef5d-4549-9a9b-64c0aa785aa1 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:26.813252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290abbd2-dc87-447a-b2da-ec6c437ec280 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:26.814018 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abbd2-dc87-447a-b2da-ec6c437ec280 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.814366 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abbd2-dc87-447a-b2da-ec6c437ec280 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.814634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290abbd2-dc87-447a-b2da-ec6c437ec280 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.815408 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290abbd2-dc87-447a-b2da-ec6c437ec280 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:26.817327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-290abbd2-dc87-447a-b2da-ec6c437ec280 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:26.848646 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1349/2730] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:44:26 2022] POST /identity/v3/projects => generated 377 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:44:26.849804 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:26.860793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cc2d09-bcbb-4cf5-b77f-89ffad82b2be admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:26.926848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb60ae5-9ac5-40d1-bf59-da14de5eb8e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:26.927518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb60ae5-9ac5-40d1-bf59-da14de5eb8e4 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.927845 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb60ae5-9ac5-40d1-bf59-da14de5eb8e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.928157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb60ae5-9ac5-40d1-bf59-da14de5eb8e4 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.928961 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb60ae5-9ac5-40d1-bf59-da14de5eb8e4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:26.931548 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb60ae5-9ac5-40d1-bf59-da14de5eb8e4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:26.955509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1382/2731] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:44:26 2022] POST /identity/v3/users => generated 289 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:44:26.958705 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290abbd2-dc87-447a-b2da-ec6c437ec280 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:26.971788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-290abbd2-dc87-447a-b2da-ec6c437ec280 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:26.978238 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fb029-b574-4969-b12a-4949c2e2dab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:26.979028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fb029-b574-4969-b12a-4949c2e2dab0 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:26.979383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fb029-b574-4969-b12a-4949c2e2dab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:26.979729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e5fb029-b574-4969-b12a-4949c2e2dab0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:26.980533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fb029-b574-4969-b12a-4949c2e2dab0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:26.982264 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e5fb029-b574-4969-b12a-4949c2e2dab0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:26.993113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1350/2732] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:26.997011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb60ae5-9ac5-40d1-bf59-da14de5eb8e4 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.007210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb60ae5-9ac5-40d1-bf59-da14de5eb8e4 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.012370 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f9238a-7791-4b92-a0c7-4d9824dc523d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.013037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9238a-7791-4b92-a0c7-4d9824dc523d admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.013313 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9238a-7791-4b92-a0c7-4d9824dc523d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.013623 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f9238a-7791-4b92-a0c7-4d9824dc523d admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.014349 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9238a-7791-4b92-a0c7-4d9824dc523d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.015935 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f9238a-7791-4b92-a0c7-4d9824dc523d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.026835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1383/2733] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:26 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:27.030943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fb029-b574-4969-b12a-4949c2e2dab0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.041821 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e5fb029-b574-4969-b12a-4949c2e2dab0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.047117 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.048002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.048279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.048553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] PATH_INFO: `/v3/projects/b83f1ec2255f4957903a1b8f165c47c0/users/0b215dd8b36942d291591d77dd661e82/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.063986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b83f1ec2255f4957903a1b8f165c47c0, user_id=0b215dd8b36942d291591d77dd661e82, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.067021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.079600 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1351/2734] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:27 2022] PUT /identity/v3/projects/b83f1ec2255f4957903a1b8f165c47c0/users/0b215dd8b36942d291591d77dd661e82/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:27.084897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061115-54a5-428c-9fda-3f3cd4dd0062 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.085182 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061115-54a5-428c-9fda-3f3cd4dd0062 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.085481 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05061115-54a5-428c-9fda-3f3cd4dd0062 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.087265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.089950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.097387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:27.111033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-05061115-54a5-428c-9fda-3f3cd4dd0062 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:27.116086 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-05061115-54a5-428c-9fda-3f3cd4dd0062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.159954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba08ecc0-1cf7-4d1f-a203-268ec8774f41 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.165218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.166120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.166396 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.166661 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] PATH_INFO: `/v3/projects/275f009e882849f5acea647caf016a45` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.167846 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] RBAC: Authorizing `identity:delete_project(project_id=275f009e882849f5acea647caf016a45)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.169767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.179325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1384/2735] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:27.187586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:27.189066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061115-54a5-428c-9fda-3f3cd4dd0062 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.191033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-05061115-54a5-428c-9fda-3f3cd4dd0062 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.218910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '275f009e882849f5acea647caf016a45', 'request_id': 'req-b9b42105-7bfd-40b8-8a96-5034489c2e14'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.224612 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '275f009e882849f5acea647caf016a45', 'request_id': 'req-b9b42105-7bfd-40b8-8a96-5034489c2e14'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.233718 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '275f009e882849f5acea647caf016a45', 'request_id': 'req-b9b42105-7bfd-40b8-8a96-5034489c2e14'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.245723 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] The token cache is being invalidate because project 275f009e882849f5acea647caf016a45 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:27.246007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.246695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-b9b42105-7bfd-40b8-8a96-5034489c2e14 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.248419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1352/2736] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:27 2022] DELETE /identity/v3/projects/275f009e882849f5acea647caf016a45 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:27.253046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fee3c-cbff-4d34-96b4-19f294d9fe59 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.253353 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fee3c-cbff-4d34-96b4-19f294d9fe59 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.253743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-080fee3c-cbff-4d34-96b4-19f294d9fe59 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.253979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05061115-54a5-428c-9fda-3f3cd4dd0062 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.272312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-080fee3c-cbff-4d34-96b4-19f294d9fe59 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:27.274190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-080fee3c-cbff-4d34-96b4-19f294d9fe59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.306551 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.307210 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.307487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.307762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.309590 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.333692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1353/2737] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:27.342049 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b700-f85f-4020-9dfd-9e32aa6a8d1d None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.342336 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b700-f85f-4020-9dfd-9e32aa6a8d1d None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.342609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45f8b700-f85f-4020-9dfd-9e32aa6a8d1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.363355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-45f8b700-f85f-4020-9dfd-9e32aa6a8d1d None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:27.364557 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-45f8b700-f85f-4020-9dfd-9e32aa6a8d1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.372976 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1354/2738] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:27.373136 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.374508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.376764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8b700-f85f-4020-9dfd-9e32aa6a8d1d None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.384889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1385/2739] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 196 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:44:27.386434 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45f8b700-f85f-4020-9dfd-9e32aa6a8d1d None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.391005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.391644 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.391927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.392202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.392922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:44:27.393228 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.394862 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.407727 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1355/2740] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:44:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:44:27.411841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.424172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92e68353-5a2a-481d-b6d3-fbb0617eda9d service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.429261 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4972b68-c38f-40af-9a30-40f3d901b181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.430098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4972b68-c38f-40af-9a30-40f3d901b181 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.430596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4972b68-c38f-40af-9a30-40f3d901b181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.430967 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4972b68-c38f-40af-9a30-40f3d901b181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.431690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4972b68-c38f-40af-9a30-40f3d901b181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.434037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4972b68-c38f-40af-9a30-40f3d901b181 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.445837 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:27.467680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1386/2741] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:44:27 2022] POST /identity/v3/projects => generated 383 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:44:27.472307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.487722 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5395e890-18b1-46ce-adf3-b4872c30157d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.587413 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6bb4-8b16-4f5b-ad66-7168ab3d2662 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.588225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6bb4-8b16-4f5b-ad66-7168ab3d2662 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.588578 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6bb4-8b16-4f5b-ad66-7168ab3d2662 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.588916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68da6bb4-8b16-4f5b-ad66-7168ab3d2662 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.589892 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da6bb4-8b16-4f5b-ad66-7168ab3d2662 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.591947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68da6bb4-8b16-4f5b-ad66-7168ab3d2662 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.619536 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1356/2742] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:44:27 2022] POST /identity/v3/users => generated 292 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:27.621017 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4972b68-c38f-40af-9a30-40f3d901b181 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.631454 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4972b68-c38f-40af-9a30-40f3d901b181 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.636470 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cb6fa-f9db-47b8-9a35-3acbf14199d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.637159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb6fa-f9db-47b8-9a35-3acbf14199d9 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.637406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb6fa-f9db-47b8-9a35-3acbf14199d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.637713 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cb6fa-f9db-47b8-9a35-3acbf14199d9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.639059 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cb6fa-f9db-47b8-9a35-3acbf14199d9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.640828 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cb6fa-f9db-47b8-9a35-3acbf14199d9 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.654511 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1387/2743] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:27.659433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6bb4-8b16-4f5b-ad66-7168ab3d2662 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.674787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68da6bb4-8b16-4f5b-ad66-7168ab3d2662 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.680492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4dd316a-f889-4028-b2ea-b97df3196ae8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.681157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd316a-f889-4028-b2ea-b97df3196ae8 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.681458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd316a-f889-4028-b2ea-b97df3196ae8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.681736 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4dd316a-f889-4028-b2ea-b97df3196ae8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.682523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd316a-f889-4028-b2ea-b97df3196ae8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.684200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4dd316a-f889-4028-b2ea-b97df3196ae8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.698260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1357/2744] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:27 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:27.702841 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cb6fa-f9db-47b8-9a35-3acbf14199d9 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.716493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cb6fa-f9db-47b8-9a35-3acbf14199d9 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.721519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.722587 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.722904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.723286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] PATH_INFO: `/v3/projects/b4fc581ecf394774ab77a0431a98c572/users/aea4a7d869114dada57c45dc2129090b/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.743871 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] RBAC: Authorizing `identity:create_grant(project_id=b4fc581ecf394774ab77a0431a98c572, user_id=aea4a7d869114dada57c45dc2129090b, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.747561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.769140 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1388/2745] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:27 2022] PUT /identity/v3/projects/b4fc581ecf394774ab77a0431a98c572/users/aea4a7d869114dada57c45dc2129090b/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:27.779633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce900e-d2a1-46c5-8878-6c930394e882 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.779767 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce900e-d2a1-46c5-8878-6c930394e882 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.780625 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efce900e-d2a1-46c5-8878-6c930394e882 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.786392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.794891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:27.795928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.808735 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-efce900e-d2a1-46c5-8878-6c930394e882 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:27.811036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-efce900e-d2a1-46c5-8878-6c930394e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.886467 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9befc66-45c5-4765-8f91-bde9cfd4c8cb admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.889595 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1358/2746] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:27.891407 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.892279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.892556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.892831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] PATH_INFO: `/v3/users/2d19d18dc08148088c7f916a0ce5caf0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.894296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=2d19d18dc08148088c7f916a0ce5caf0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.896593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.901905 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce900e-d2a1-46c5-8878-6c930394e882 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:27.903622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-efce900e-d2a1-46c5-8878-6c930394e882 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:27.954442 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2d19d18dc08148088c7f916a0ce5caf0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.962201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2d19d18dc08148088c7f916a0ce5caf0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.971201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efce900e-d2a1-46c5-8878-6c930394e882 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:27.973023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2d19d18dc08148088c7f916a0ce5caf0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.975468 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:27.976806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:27.977145 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:27.977528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:27.987320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:27.988852 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:27.990599 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2d19d18dc08148088c7f916a0ce5caf0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.991473 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-6254dbfb-7407-4a03-805d-71241fe4be1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2d19d18dc08148088c7f916a0ce5caf0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:27.999087 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1389/2747] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:27 2022] DELETE /identity/v3/users/2d19d18dc08148088c7f916a0ce5caf0 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:27.999640 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1359/2748] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:44:28.003196 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859ba8-7d91-41b5-97b6-67ff4b8f2561 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:28.003582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859ba8-7d91-41b5-97b6-67ff4b8f2561 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:28.003916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21859ba8-7d91-41b5-97b6-67ff4b8f2561 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:28.022763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-21859ba8-7d91-41b5-97b6-67ff4b8f2561 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:28.024731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-21859ba8-7d91-41b5-97b6-67ff4b8f2561 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:28.055964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:28.093571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1390/2749] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:28.107014 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:28.109663 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:28.124933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22eb05c-7d16-41ac-8fc5-46751ad5f9d9 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:28.202020 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:28.203021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:28.203429 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:28.203815 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:28.218215 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:28.220184 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:28.234120 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1360/2750] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:28.795448 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca57a-3b61-4ae2-bc4d-94ec107df744 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:28.796315 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca57a-3b61-4ae2-bc4d-94ec107df744 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:28.796658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fca57a-3b61-4ae2-bc4d-94ec107df744 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:28.831364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-07fca57a-3b61-4ae2-bc4d-94ec107df744 None None] MFA Rules not processed for user `aea4a7d869114dada57c45dc2129090b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:28.832701 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-07fca57a-3b61-4ae2-bc4d-94ec107df744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:28.924437 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1391/2751] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:28 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:28.935844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:28.938931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:28.976260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca57a-3b61-4ae2-bc4d-94ec107df744 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:28.977746 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-07fca57a-3b61-4ae2-bc4d-94ec107df744 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:28.994704 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fca57a-3b61-4ae2-bc4d-94ec107df744 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:29.000274 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:29.001143 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:29.001462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:29.001818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] PATH_INFO: `/v3/projects/9b9761bf0b4549189ba06d94888c7440` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:29.003625 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9b9761bf0b4549189ba06d94888c7440)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:29.005706 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:29.025517 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aaa938-510f-4604-8711-27ef9359000f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:29.031056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddde82-9c34-4fc1-8c2d-8b0973132429 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:29.031969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddde82-9c34-4fc1-8c2d-8b0973132429 service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:29.032458 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddde82-9c34-4fc1-8c2d-8b0973132429 service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:29.032957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4ddde82-9c34-4fc1-8c2d-8b0973132429 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:29.040869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:29.046189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddde82-9c34-4fc1-8c2d-8b0973132429 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:29.048211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4ddde82-9c34-4fc1-8c2d-8b0973132429 service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:29.062523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1361/2752] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:29.093208 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9b9761bf0b4549189ba06d94888c7440', 'request_id': 'req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.104185 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9b9761bf0b4549189ba06d94888c7440', 'request_id': 'req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.116940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9b9761bf0b4549189ba06d94888c7440', 'request_id': 'req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.133592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] The token cache is being invalidate because project 9b9761bf0b4549189ba06d94888c7440 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:29.133780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.134544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.140950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddde82-9c34-4fc1-8c2d-8b0973132429 service cinder] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:29.141464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1392/2753] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:28 2022] DELETE /identity/v3/projects/9b9761bf0b4549189ba06d94888c7440 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:44:29.155335 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4ddde82-9c34-4fc1-8c2d-8b0973132429 service cinder] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:29.230737 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:29.231623 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:29.231895 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:29.232185 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] PATH_INFO: `/v3/users/2ea78614207d48d2beed3a6d532bc388` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:29.233441 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2ea78614207d48d2beed3a6d532bc388)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:29.235388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:29.300318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2ea78614207d48d2beed3a6d532bc388'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.364064 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2ea78614207d48d2beed3a6d532bc388'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.373987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2ea78614207d48d2beed3a6d532bc388'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.381911 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2ea78614207d48d2beed3a6d532bc388'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.382703 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-c5b2096b-8e43-4167-9e0b-6bf87472eac8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2ea78614207d48d2beed3a6d532bc388'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.400208 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1362/2754] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:44:29 2022] DELETE /identity/v3/users/2ea78614207d48d2beed3a6d532bc388 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:29.788121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:29.790303 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:29.809121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8f7679-d0a7-472b-86f7-44b8bfbfa4a0 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:29.867523 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:29.887944 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:29.888900 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:29.889356 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:29.889690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] PATH_INFO: `/v3/projects/9ed6b250f981480fb4992706c6da7305` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:29.891097 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9ed6b250f981480fb4992706c6da7305)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:29.893125 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:29.972000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9ed6b250f981480fb4992706c6da7305', 'request_id': 'req-4381e58e-db39-4ade-999a-dbcec00e4e95'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.982073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9ed6b250f981480fb4992706c6da7305', 'request_id': 'req-4381e58e-db39-4ade-999a-dbcec00e4e95'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:29.998035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9ed6b250f981480fb4992706c6da7305', 'request_id': 'req-4381e58e-db39-4ade-999a-dbcec00e4e95'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:30.015876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] The token cache is being invalidate because project 9ed6b250f981480fb4992706c6da7305 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:44:30.016499 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:30.017384 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-4381e58e-db39-4ade-999a-dbcec00e4e95 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:44:30.019531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1393/2755] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:44:29 2022] DELETE /identity/v3/projects/9ed6b250f981480fb4992706c6da7305 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:30.025344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828600c7-6a1e-4a3f-b3ea-8e3294efa185 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.026022 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828600c7-6a1e-4a3f-b3ea-8e3294efa185 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.026701 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828600c7-6a1e-4a3f-b3ea-8e3294efa185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.050813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-828600c7-6a1e-4a3f-b3ea-8e3294efa185 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:30.051987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-828600c7-6a1e-4a3f-b3ea-8e3294efa185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:30.145957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1363/2756] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:30.147719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4e406-69cb-443e-9443-96d38e9d44ed None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.148556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4e406-69cb-443e-9443-96d38e9d44ed None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.148838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f4e406-69cb-443e-9443-96d38e9d44ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.183809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-f3f4e406-69cb-443e-9443-96d38e9d44ed None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:30.185256 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f3f4e406-69cb-443e-9443-96d38e9d44ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:30.202071 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1394/2757] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 56 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:30.206010 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828600c7-6a1e-4a3f-b3ea-8e3294efa185 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:30.218015 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828600c7-6a1e-4a3f-b3ea-8e3294efa185 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:30.224579 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:30.225516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.227042 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.227813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.228785 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:44:30.229452 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:30.231312 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:30.242367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:30.247471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1364/2758] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:44:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:44:30.252724 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4e406-69cb-443e-9443-96d38e9d44ed None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:30.271807 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f4e406-69cb-443e-9443-96d38e9d44ed None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:30.277070 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359f8d0-3715-42cf-8067-be0caec56567 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:30.277801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f8d0-3715-42cf-8067-be0caec56567 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.278082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f8d0-3715-42cf-8067-be0caec56567 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.278359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b359f8d0-3715-42cf-8067-be0caec56567 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.279051 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359f8d0-3715-42cf-8067-be0caec56567 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:30.280966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b359f8d0-3715-42cf-8067-be0caec56567 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:30.317433 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1395/2759] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:44:30 2022] POST /identity/v3/projects => generated 375 bytes in 66 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:30.322387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:30.334433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c767d6e-6085-4f80-9126-8cb75651a720 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:30.411444 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5ec32-2f3b-428c-8427-bfa0494fdca2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:30.412197 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ec32-2f3b-428c-8427-bfa0494fdca2 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.414368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ec32-2f3b-428c-8427-bfa0494fdca2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.414368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a5ec32-2f3b-428c-8427-bfa0494fdca2 admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.414368 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5ec32-2f3b-428c-8427-bfa0494fdca2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:30.416233 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61a5ec32-2f3b-428c-8427-bfa0494fdca2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:30.464111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1365/2760] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:44:30 2022] POST /identity/v3/users => generated 288 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:30.469449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359f8d0-3715-42cf-8067-be0caec56567 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:30.486138 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b359f8d0-3715-42cf-8067-be0caec56567 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:30.492452 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc9e24-c7be-45b2-9354-a42137317f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:30.493446 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9e24-c7be-45b2-9354-a42137317f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.493734 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9e24-c7be-45b2-9354-a42137317f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.494011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bc9e24-c7be-45b2-9354-a42137317f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.494767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc9e24-c7be-45b2-9354-a42137317f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:30.496428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bc9e24-c7be-45b2-9354-a42137317f91 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:30.518605 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1396/2761] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:30.518957 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5ec32-2f3b-428c-8427-bfa0494fdca2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:30.535774 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61a5ec32-2f3b-428c-8427-bfa0494fdca2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:30.562256 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea199cb-c221-4f02-b7b9-0a74b93cac21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:30.564634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea199cb-c221-4f02-b7b9-0a74b93cac21 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.565111 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea199cb-c221-4f02-b7b9-0a74b93cac21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.565568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea199cb-c221-4f02-b7b9-0a74b93cac21 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.569400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea199cb-c221-4f02-b7b9-0a74b93cac21 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:30.571648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea199cb-c221-4f02-b7b9-0a74b93cac21 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:30.602381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1366/2762] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:30 2022] GET /identity/v3/roles => generated 1420 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:30.606527 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc9e24-c7be-45b2-9354-a42137317f91 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:30.633924 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ade14-77b1-42ef-845f-59829a3b14de None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.634431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ade14-77b1-42ef-845f-59829a3b14de None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.634576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bc9e24-c7be-45b2-9354-a42137317f91 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:30.635007 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f4ade14-77b1-42ef-845f-59829a3b14de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.641239 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799603c6-f51d-4fb3-8e90-da86cb3dd6db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:30.642458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799603c6-f51d-4fb3-8e90-da86cb3dd6db admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.642458 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799603c6-f51d-4fb3-8e90-da86cb3dd6db admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.642711 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799603c6-f51d-4fb3-8e90-da86cb3dd6db admin admin] PATH_INFO: `/v3/projects/0fcb871bf5ec47aab32b50ce22d31d82/users/ab8e58559f1148fc9ebf8f55ff3f2668/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.666737 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-8f4ade14-77b1-42ef-845f-59829a3b14de None None] MFA Rules not processed for user `aea4a7d869114dada57c45dc2129090b`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:30.668055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-8f4ade14-77b1-42ef-845f-59829a3b14de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:30.675231 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799603c6-f51d-4fb3-8e90-da86cb3dd6db admin admin] RBAC: Authorizing `identity:create_grant(project_id=0fcb871bf5ec47aab32b50ce22d31d82, user_id=ab8e58559f1148fc9ebf8f55ff3f2668, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:30.685719 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799603c6-f51d-4fb3-8e90-da86cb3dd6db admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:30.704369 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1397/2763] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:30 2022] PUT /identity/v3/projects/0fcb871bf5ec47aab32b50ce22d31d82/users/ab8e58559f1148fc9ebf8f55ff3f2668/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:30.715085 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d337d-1564-4983-b19d-e6f65952ce23 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.715375 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d337d-1564-4983-b19d-e6f65952ce23 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.717741 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7d337d-1564-4983-b19d-e6f65952ce23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.747796 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1367/2764] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:30 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:30.765600 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-4b7d337d-1564-4983-b19d-e6f65952ce23 None None] MFA Rules not processed for user `ab8e58559f1148fc9ebf8f55ff3f2668`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:30.766976 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-4b7d337d-1564-4983-b19d-e6f65952ce23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:30.862866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1398/2765] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:30.869333 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ade14-77b1-42ef-845f-59829a3b14de None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:30.881904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f4ade14-77b1-42ef-845f-59829a3b14de None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:30.959384 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8ea8-94bd-4292-8075-ea812094fbd3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:30.960055 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8ea8-94bd-4292-8075-ea812094fbd3 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:30.960334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8ea8-94bd-4292-8075-ea812094fbd3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:30.960637 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea8ea8-94bd-4292-8075-ea812094fbd3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:30.961432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea8ea8-94bd-4292-8075-ea812094fbd3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:30.963808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea8ea8-94bd-4292-8075-ea812094fbd3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:30.998601 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1368/2766] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:44:30 2022] POST /identity/v3/projects => generated 375 bytes in 131 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:31.003163 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d337d-1564-4983-b19d-e6f65952ce23 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:31.010710 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:31.018658 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7d337d-1564-4983-b19d-e6f65952ce23 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:31.090772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4fa6-0e9c-48a7-b479-155ba80d6228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:31.091362 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4fa6-0e9c-48a7-b479-155ba80d6228 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:31.091644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4fa6-0e9c-48a7-b479-155ba80d6228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:31.092207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4c4fa6-0e9c-48a7-b479-155ba80d6228 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:31.092615 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4fa6-0e9c-48a7-b479-155ba80d6228 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:31.094630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4c4fa6-0e9c-48a7-b479-155ba80d6228 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:31.121806 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1399/2767] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:44:31 2022] POST /identity/v3/users => generated 294 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:44:31.126784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8ea8-94bd-4292-8075-ea812094fbd3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:31.139191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea8ea8-94bd-4292-8075-ea812094fbd3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:31.145565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9a54-c07e-4ce7-ad94-16d259c52572 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:31.145960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9a54-c07e-4ce7-ad94-16d259c52572 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:31.146328 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9a54-c07e-4ce7-ad94-16d259c52572 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:31.146877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef3d9a54-c07e-4ce7-ad94-16d259c52572 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:31.147516 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9a54-c07e-4ce7-ad94-16d259c52572 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:31.150019 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef3d9a54-c07e-4ce7-ad94-16d259c52572 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:31.153672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:31.166432 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1369/2768] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:31.170489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4fa6-0e9c-48a7-b479-155ba80d6228 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:31.182786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4c4fa6-0e9c-48a7-b479-155ba80d6228 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:31.188800 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa7df-cc96-42a2-aa59-81085c9d65c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:31.189832 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa7df-cc96-42a2-aa59-81085c9d65c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:31.190179 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa7df-cc96-42a2-aa59-81085c9d65c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:31.190524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f62fa7df-cc96-42a2-aa59-81085c9d65c8 admin admin] PATH_INFO: `/v3/projects/696967496b62442aaba82b5acd655d67/users/d08b69f3210b4cedac4c86769b277a09/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:31.209122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa7df-cc96-42a2-aa59-81085c9d65c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696967496b62442aaba82b5acd655d67, user_id=d08b69f3210b4cedac4c86769b277a09, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:31.211973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f62fa7df-cc96-42a2-aa59-81085c9d65c8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:31.229047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1400/2769] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:31 2022] PUT /identity/v3/projects/696967496b62442aaba82b5acd655d67/users/d08b69f3210b4cedac4c86769b277a09/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:31.232226 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9a54-c07e-4ce7-ad94-16d259c52572 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:31.242918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef3d9a54-c07e-4ce7-ad94-16d259c52572 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:31.310963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:31.311898 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:31.312252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:31.312583 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:31.313375 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:31.315324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:31.326914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1370/2770] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:31 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:31.330966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa7df-cc96-42a2-aa59-81085c9d65c8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:31.342858 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f62fa7df-cc96-42a2-aa59-81085c9d65c8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:31.348332 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61355cbe-eec2-4856-8d35-f1b486774273 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:31.349237 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61355cbe-eec2-4856-8d35-f1b486774273 admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:31.349556 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61355cbe-eec2-4856-8d35-f1b486774273 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:31.349829 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61355cbe-eec2-4856-8d35-f1b486774273 admin admin] PATH_INFO: `/v3/projects/696967496b62442aaba82b5acd655d67/users/d08b69f3210b4cedac4c86769b277a09/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:31.352624 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61355cbe-eec2-4856-8d35-f1b486774273 admin admin] RBAC: Authorizing `identity:create_grant(project_id=696967496b62442aaba82b5acd655d67, user_id=d08b69f3210b4cedac4c86769b277a09, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:31.355374 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61355cbe-eec2-4856-8d35-f1b486774273 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:31.369519 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1401/2771] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:31 2022] PUT /identity/v3/projects/696967496b62442aaba82b5acd655d67/users/d08b69f3210b4cedac4c86769b277a09/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:31.403665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:31.407618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:31.439943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea28f3-8210-491c-a3d1-0aec657fbbaa None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:31.440461 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea28f3-8210-491c-a3d1-0aec657fbbaa None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:31.440747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89ea28f3-8210-491c-a3d1-0aec657fbbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:31.484561 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-89ea28f3-8210-491c-a3d1-0aec657fbbaa None None] MFA Rules not processed for user `d08b69f3210b4cedac4c86769b277a09`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:31.485822 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-89ea28f3-8210-491c-a3d1-0aec657fbbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:31.530672 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4264d9d-451c-467c-8018-a3d97c511cd6 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:31.591643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7720c350-84fd-44ed-b524-a1b1e30b21d8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:31.592364 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720c350-84fd-44ed-b524-a1b1e30b21d8 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:31.592763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1402/2772] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:31 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:44:31.592901 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720c350-84fd-44ed-b524-a1b1e30b21d8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:31.593302 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7720c350-84fd-44ed-b524-a1b1e30b21d8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:31.596556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7720c350-84fd-44ed-b524-a1b1e30b21d8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:31.604981 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea28f3-8210-491c-a3d1-0aec657fbbaa None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:31.607293 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-89ea28f3-8210-491c-a3d1-0aec657fbbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:31.613894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720c350-84fd-44ed-b524-a1b1e30b21d8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:31.615473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7720c350-84fd-44ed-b524-a1b1e30b21d8 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:31.625994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1371/2773] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:31 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 225 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:31.666831 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:31.683801 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89ea28f3-8210-491c-a3d1-0aec657fbbaa None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:31.689299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:31.689679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:31.689987 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:31.690772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:31.780699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:31.783602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:31.797154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1403/2774] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:31 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:33.028589 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cee3-822b-451b-bae5-364bb5f04ca5 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:33.029162 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cee3-822b-451b-bae5-364bb5f04ca5 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:33.029362 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad11cee3-822b-451b-bae5-364bb5f04ca5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:33.072657 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ad11cee3-822b-451b-bae5-364bb5f04ca5 None None] MFA Rules not processed for user `0b215dd8b36942d291591d77dd661e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:33.074512 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ad11cee3-822b-451b-bae5-364bb5f04ca5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:33.127354 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=100 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:33.157397 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1372/2775] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:33 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:33.161979 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:33.164217 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:33.240966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c856e4ce-18a0-4b39-b223-34a44add5261 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:33.246678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08065160-ddb9-42d4-b4be-10391c8b3bb7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:33.247468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065160-ddb9-42d4-b4be-10391c8b3bb7 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:33.247863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065160-ddb9-42d4-b4be-10391c8b3bb7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:33.248205 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08065160-ddb9-42d4-b4be-10391c8b3bb7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:33.249533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08065160-ddb9-42d4-b4be-10391c8b3bb7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:33.252088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08065160-ddb9-42d4-b4be-10391c8b3bb7 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:33.283255 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1404/2776] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:44:33 2022] POST /identity/v3/projects => generated 379 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:33.287260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11cee3-822b-451b-bae5-364bb5f04ca5 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:33.300080 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad11cee3-822b-451b-bae5-364bb5f04ca5 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:33.366207 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c7181-fa2e-41c6-9d66-9bdcfe1f3dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:33.368160 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7181-fa2e-41c6-9d66-9bdcfe1f3dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:33.368449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7181-fa2e-41c6-9d66-9bdcfe1f3dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:33.368729 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54c7181-fa2e-41c6-9d66-9bdcfe1f3dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:33.369473 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c7181-fa2e-41c6-9d66-9bdcfe1f3dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:33.372506 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54c7181-fa2e-41c6-9d66-9bdcfe1f3dfb admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:33.399025 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1373/2777] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:44:33 2022] POST /identity/v3/users => generated 296 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:44:33.403248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08065160-ddb9-42d4-b4be-10391c8b3bb7 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:33.422463 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08065160-ddb9-42d4-b4be-10391c8b3bb7 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:33.433765 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155435de-1fb3-48a6-b969-1d6381439310 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:33.434680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155435de-1fb3-48a6-b969-1d6381439310 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:33.435040 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155435de-1fb3-48a6-b969-1d6381439310 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:33.435530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-155435de-1fb3-48a6-b969-1d6381439310 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:33.437631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155435de-1fb3-48a6-b969-1d6381439310 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:33.445395 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-155435de-1fb3-48a6-b969-1d6381439310 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:33.467572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1405/2778] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 65 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:33.474457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c7181-fa2e-41c6-9d66-9bdcfe1f3dfb admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:33.492377 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54c7181-fa2e-41c6-9d66-9bdcfe1f3dfb admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:33.498037 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc753-ed26-48d0-a79f-11e287f5b917 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:33.498947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc753-ed26-48d0-a79f-11e287f5b917 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:33.499227 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc753-ed26-48d0-a79f-11e287f5b917 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:33.499495 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc6cc753-ed26-48d0-a79f-11e287f5b917 admin admin] PATH_INFO: `/v3/projects/ff94ce73b2844afe96f6561b9b5e320e/users/3d1f1b4605444019a2f55fb9edaec7bd/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:33.523094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cc753-ed26-48d0-a79f-11e287f5b917 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff94ce73b2844afe96f6561b9b5e320e, user_id=3d1f1b4605444019a2f55fb9edaec7bd, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:33.526860 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc6cc753-ed26-48d0-a79f-11e287f5b917 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:33.561092 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1374/2779] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:33 2022] PUT /identity/v3/projects/ff94ce73b2844afe96f6561b9b5e320e/users/3d1f1b4605444019a2f55fb9edaec7bd/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:33.565056 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155435de-1fb3-48a6-b969-1d6381439310 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:33.592862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-155435de-1fb3-48a6-b969-1d6381439310 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:33.696129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f1719-771c-4e73-8fd6-acc1e19cacc8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:33.697053 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1719-771c-4e73-8fd6-acc1e19cacc8 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:33.697397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1719-771c-4e73-8fd6-acc1e19cacc8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:33.697834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57f1719-771c-4e73-8fd6-acc1e19cacc8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:33.698679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f1719-771c-4e73-8fd6-acc1e19cacc8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:33.700969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57f1719-771c-4e73-8fd6-acc1e19cacc8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:33.718522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1406/2780] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:44:33 2022] GET /identity/v3/roles => generated 1420 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:44:33.720440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc753-ed26-48d0-a79f-11e287f5b917 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:33.733383 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc6cc753-ed26-48d0-a79f-11e287f5b917 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:33.748961 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bcfa05-0113-4044-a7b7-e6a3a2ff1851 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:33.749908 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcfa05-0113-4044-a7b7-e6a3a2ff1851 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:33.753530 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcfa05-0113-4044-a7b7-e6a3a2ff1851 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:33.753944 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bcfa05-0113-4044-a7b7-e6a3a2ff1851 admin admin] PATH_INFO: `/v3/projects/ff94ce73b2844afe96f6561b9b5e320e/users/3d1f1b4605444019a2f55fb9edaec7bd/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:33.759446 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcfa05-0113-4044-a7b7-e6a3a2ff1851 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff94ce73b2844afe96f6561b9b5e320e, user_id=3d1f1b4605444019a2f55fb9edaec7bd, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:33.766883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bcfa05-0113-4044-a7b7-e6a3a2ff1851 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:33.780419 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1375/2781] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:44:33 2022] PUT /identity/v3/projects/ff94ce73b2844afe96f6561b9b5e320e/users/3d1f1b4605444019a2f55fb9edaec7bd/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:44:36.719063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f1719-771c-4e73-8fd6-acc1e19cacc8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:36.725731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:36.789648 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57f1719-771c-4e73-8fd6-acc1e19cacc8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:36.849662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:36.850626 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:36.851132 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:36.851596 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:36.932118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:36.933941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:36.945903 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1407/2782] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:36 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 227 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:39.382960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb67af-6ea5-4e5a-b73d-0e3df3e19cdb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:39.383456 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb67af-6ea5-4e5a-b73d-0e3df3e19cdb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:39.383556 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48bb67af-6ea5-4e5a-b73d-0e3df3e19cdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:39.411620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-48bb67af-6ea5-4e5a-b73d-0e3df3e19cdb None None] MFA Rules not processed for user `3d1f1b4605444019a2f55fb9edaec7bd`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:44:39.412799 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-48bb67af-6ea5-4e5a-b73d-0e3df3e19cdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:39.483292 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1376/2783] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:44:39 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:44:39.497766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:44:39.499660 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:44:39.576883 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e299912a-8a51-42e3-a340-6602c4f47cbd service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:44:39.582388 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:44:39.583033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:44:39.583314 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:44:39.583588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:44:39.588777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=100 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:39.639267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:44:39.640846 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:44:39.649762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1408/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:44:39 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:44:49.480448 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:44:49.645636 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=24 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:00.501620 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451e0b-b530-4292-8328-3c88eabc4dad None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:00.502247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451e0b-b530-4292-8328-3c88eabc4dad None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:00.502247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66451e0b-b530-4292-8328-3c88eabc4dad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:00.530596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-66451e0b-b530-4292-8328-3c88eabc4dad None None] MFA Rules not processed for user `0b215dd8b36942d291591d77dd661e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:00.531847 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-66451e0b-b530-4292-8328-3c88eabc4dad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:00.559992 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1377/2785] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:00 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:00.880898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:00.882336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:00.980546 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1920b9-1f6c-4d76-87ff-3e309fdd65ba service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:00.984252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37fe42-a9d7-4fe1-9859-0d89ed0ce2ce service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:00.984890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fe42-a9d7-4fe1-9859-0d89ed0ce2ce service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:00.985169 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fe42-a9d7-4fe1-9859-0d89ed0ce2ce service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:00.985464 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37fe42-a9d7-4fe1-9859-0d89ed0ce2ce service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:00.987206 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9f37fe42-a9d7-4fe1-9859-0d89ed0ce2ce service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:00.997376 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37fe42-a9d7-4fe1-9859-0d89ed0ce2ce service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:00.998838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37fe42-a9d7-4fe1-9859-0d89ed0ce2ce service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:01.007878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1409/2786] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:45:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 127 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:45:01.322236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66451e0b-b530-4292-8328-3c88eabc4dad None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:01.427692 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66451e0b-b530-4292-8328-3c88eabc4dad None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:01.433665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:01.434542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:01.434825 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:01.435101 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] PATH_INFO: `/v3/users/ab8e58559f1148fc9ebf8f55ff3f2668` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:01.436349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ab8e58559f1148fc9ebf8f55ff3f2668)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:01.444319 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:01.525122 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ab8e58559f1148fc9ebf8f55ff3f2668'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:01.537549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ab8e58559f1148fc9ebf8f55ff3f2668'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:01.545558 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ab8e58559f1148fc9ebf8f55ff3f2668'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:01.552968 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ab8e58559f1148fc9ebf8f55ff3f2668'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:01.553553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ab8e58559f1148fc9ebf8f55ff3f2668'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:01.560087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1378/2787] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:45:01 2022] DELETE /identity/v3/users/ab8e58559f1148fc9ebf8f55ff3f2668 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:45:01.565109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8b722-8fac-4801-aea5-b60eda47e063 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:01.565521 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8b722-8fac-4801-aea5-b60eda47e063 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:01.565997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b8b722-8fac-4801-aea5-b60eda47e063 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:01.607336 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-76b8b722-8fac-4801-aea5-b60eda47e063 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:01.608562 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-76b8b722-8fac-4801-aea5-b60eda47e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:01.672367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1410/2788] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:01.682016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:01.684143 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:01.715463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:01.749913 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d8a04e-ecac-4f28-b3e0-5d72afba5c80 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:01.753575 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74a58e-9c77-494b-ab54-c82ee18fc31f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:01.754224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74a58e-9c77-494b-ab54-c82ee18fc31f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:01.754505 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74a58e-9c77-494b-ab54-c82ee18fc31f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:01.754789 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a74a58e-9c77-494b-ab54-c82ee18fc31f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:01.764471 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74a58e-9c77-494b-ab54-c82ee18fc31f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:01.765981 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a74a58e-9c77-494b-ab54-c82ee18fc31f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:01.776915 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1379/2789] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:45:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:45:02.051668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8b722-8fac-4801-aea5-b60eda47e063 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:02.053257 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-76b8b722-8fac-4801-aea5-b60eda47e063 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:02.073394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76b8b722-8fac-4801-aea5-b60eda47e063 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:02.078964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:02.080397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:02.080397 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:02.080616 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] PATH_INFO: `/v3/projects/0fcb871bf5ec47aab32b50ce22d31d82` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:02.081775 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0fcb871bf5ec47aab32b50ce22d31d82)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:02.083886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:02.129471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:02.137402 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0fcb871bf5ec47aab32b50ce22d31d82', 'request_id': 'req-c28f043b-20d7-47aa-8516-1a29f57bc40b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.143500 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0fcb871bf5ec47aab32b50ce22d31d82', 'request_id': 'req-c28f043b-20d7-47aa-8516-1a29f57bc40b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.150676 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0fcb871bf5ec47aab32b50ce22d31d82', 'request_id': 'req-c28f043b-20d7-47aa-8516-1a29f57bc40b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.163487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] The token cache is being invalidate because project 0fcb871bf5ec47aab32b50ce22d31d82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:45:02.163773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.164427 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.166012 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1411/2790] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:45:02 2022] DELETE /identity/v3/projects/0fcb871bf5ec47aab32b50ce22d31d82 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:45:02.170097 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74a58e-9c77-494b-ab54-c82ee18fc31f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:02.179677 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a74a58e-9c77-494b-ab54-c82ee18fc31f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:02.239095 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:02.239960 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:02.240241 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:02.240515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] PATH_INFO: `/v3/users/d08b69f3210b4cedac4c86769b277a09` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:02.241713 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] RBAC: Authorizing `identity:delete_user(user_id=d08b69f3210b4cedac4c86769b277a09)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:02.243615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:02.289330 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd08b69f3210b4cedac4c86769b277a09'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.301124 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd08b69f3210b4cedac4c86769b277a09'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.308726 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd08b69f3210b4cedac4c86769b277a09'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.316464 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd08b69f3210b4cedac4c86769b277a09'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.317085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba5bbf38-a119-4e15-aa9e-425c8ebead5d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd08b69f3210b4cedac4c86769b277a09'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.323787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1380/2791] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:45:02 2022] DELETE /identity/v3/users/d08b69f3210b4cedac4c86769b277a09 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:45:02.616911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:02.619430 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:02.633489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28f043b-20d7-47aa-8516-1a29f57bc40b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:02.700424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:02.701202 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:02.701509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:02.701793 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] PATH_INFO: `/v3/projects/696967496b62442aaba82b5acd655d67` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:02.703007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] RBAC: Authorizing `identity:delete_project(project_id=696967496b62442aaba82b5acd655d67)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:02.704925 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:02.754899 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '696967496b62442aaba82b5acd655d67', 'request_id': 'req-12cf4f26-3f22-483a-8b7a-5d163cb0381d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.761696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '696967496b62442aaba82b5acd655d67', 'request_id': 'req-12cf4f26-3f22-483a-8b7a-5d163cb0381d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.769242 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '696967496b62442aaba82b5acd655d67', 'request_id': 'req-12cf4f26-3f22-483a-8b7a-5d163cb0381d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.781692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] The token cache is being invalidate because project 696967496b62442aaba82b5acd655d67 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:45:02.782220 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.782895 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-12cf4f26-3f22-483a-8b7a-5d163cb0381d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:02.784790 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1412/2792] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:45:02 2022] DELETE /identity/v3/projects/696967496b62442aaba82b5acd655d67 => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:45:02.789954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fe52b-47e8-41da-b34f-3970a23453b7 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:02.790523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fe52b-47e8-41da-b34f-3970a23453b7 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:02.790523 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4fe52b-47e8-41da-b34f-3970a23453b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:02.842057 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-5f4fe52b-47e8-41da-b34f-3970a23453b7 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:02.843318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-5f4fe52b-47e8-41da-b34f-3970a23453b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:02.857091 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:02.908588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1381/2793] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:02.917101 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d00b3-3433-4711-b3a7-b5c5794b7758 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:02.917476 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d00b3-3433-4711-b3a7-b5c5794b7758 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:02.917756 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141d00b3-3433-4711-b3a7-b5c5794b7758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:02.937365 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-141d00b3-3433-4711-b3a7-b5c5794b7758 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:02.938592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-141d00b3-3433-4711-b3a7-b5c5794b7758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:02.946334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1413/2794] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:02.951115 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fe52b-47e8-41da-b34f-3970a23453b7 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:02.960667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4fe52b-47e8-41da-b34f-3970a23453b7 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:02.965380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:02.966041 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:02.966321 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:02.966596 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:02.967314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80192) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:45:02.967615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:02.969187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:02.980894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1382/2795] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:45:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 12 08:45:02.985352 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d00b3-3433-4711-b3a7-b5c5794b7758 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:02.996786 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141d00b3-3433-4711-b3a7-b5c5794b7758 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:03.001492 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a36c52-fef5-4e62-8b33-f9188c4ad711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:03.002154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a36c52-fef5-4e62-8b33-f9188c4ad711 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:03.002436 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a36c52-fef5-4e62-8b33-f9188c4ad711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:03.002758 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58a36c52-fef5-4e62-8b33-f9188c4ad711 admin admin] PATH_INFO: `/v3/projects` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:03.003601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a36c52-fef5-4e62-8b33-f9188c4ad711 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:03.005522 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58a36c52-fef5-4e62-8b33-f9188c4ad711 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:03.033487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1414/2796] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:45:02 2022] POST /identity/v3/projects => generated 375 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:45:03.038087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:03.048782 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1171377a-8eac-4737-9374-3b16be3398b1 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:03.114416 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7cf3-a4b3-4b03-a3a2-07510f96d32c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:03.115082 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7cf3-a4b3-4b03-a3a2-07510f96d32c admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:03.115369 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7cf3-a4b3-4b03-a3a2-07510f96d32c admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:03.115647 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81a7cf3-a4b3-4b03-a3a2-07510f96d32c admin admin] PATH_INFO: `/v3/users` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:03.116343 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a7cf3-a4b3-4b03-a3a2-07510f96d32c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:03.118302 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81a7cf3-a4b3-4b03-a3a2-07510f96d32c admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:03.143934 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1383/2797] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:45:03 2022] POST /identity/v3/users => generated 288 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:45:03.145663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a36c52-fef5-4e62-8b33-f9188c4ad711 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:03.156655 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58a36c52-fef5-4e62-8b33-f9188c4ad711 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:03.161317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c3f25-0c5b-46b9-9d65-b99affa61830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:03.162060 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c3f25-0c5b-46b9-9d65-b99affa61830 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:03.162265 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c3f25-0c5b-46b9-9d65-b99affa61830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:03.162540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1c3f25-0c5b-46b9-9d65-b99affa61830 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:03.163331 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c3f25-0c5b-46b9-9d65-b99affa61830 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:03.164917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1c3f25-0c5b-46b9-9d65-b99affa61830 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:03.175916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1415/2798] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:45:03.179979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7cf3-a4b3-4b03-a3a2-07510f96d32c admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:03.190998 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81a7cf3-a4b3-4b03-a3a2-07510f96d32c admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:03.195604 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14a9886-3317-431a-8795-8fdd9290787f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:03.196260 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a9886-3317-431a-8795-8fdd9290787f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:03.196541 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a9886-3317-431a-8795-8fdd9290787f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:03.196814 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14a9886-3317-431a-8795-8fdd9290787f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:03.197572 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a9886-3317-431a-8795-8fdd9290787f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:03.199845 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14a9886-3317-431a-8795-8fdd9290787f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:03.210457 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1384/2799] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:45:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:45:03.214763 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c3f25-0c5b-46b9-9d65-b99affa61830 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:03.225750 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1c3f25-0c5b-46b9-9d65-b99affa61830 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:03.230642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:03.231516 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:03.231792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:03.232066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] PATH_INFO: `/v3/projects/f18a9d49a3404c04bdbf3197a59bc390/users/5c45f192ca374b99aa2b040f3ddb59f3/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:03.247865 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f18a9d49a3404c04bdbf3197a59bc390, user_id=5c45f192ca374b99aa2b040f3ddb59f3, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:03.251081 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:03.255372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=85,keystone:DELETE=11,keystone:INSERT=4 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:03.269725 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1416/2800] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:45:03 2022] PUT /identity/v3/projects/f18a9d49a3404c04bdbf3197a59bc390/users/5c45f192ca374b99aa2b040f3ddb59f3/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:45:03.281209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970bcdb-683e-4f09-b872-4ab56c556dfb None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:03.281528 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970bcdb-683e-4f09-b872-4ab56c556dfb None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:03.281812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f970bcdb-683e-4f09-b872-4ab56c556dfb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:03.310502 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f970bcdb-683e-4f09-b872-4ab56c556dfb None None] MFA Rules not processed for user `5c45f192ca374b99aa2b040f3ddb59f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:03.311775 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f970bcdb-683e-4f09-b872-4ab56c556dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:03.379742 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1385/2801] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:03 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:03.391888 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:03.394277 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:03.457973 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f4468c-a358-45b9-b045-323fbba6140a admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:03.461663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ab4a4-0eb9-4a10-950c-181dabda15a6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:03.462236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ab4a4-0eb9-4a10-950c-181dabda15a6 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:03.462486 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ab4a4-0eb9-4a10-950c-181dabda15a6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:03.462808 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942ab4a4-0eb9-4a10-950c-181dabda15a6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:03.472491 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ab4a4-0eb9-4a10-950c-181dabda15a6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:03.473980 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942ab4a4-0eb9-4a10-950c-181dabda15a6 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:03.483726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1417/2802] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:45:03 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:45:08.521472 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970bcdb-683e-4f09-b872-4ab56c556dfb None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:08.522963 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f970bcdb-683e-4f09-b872-4ab56c556dfb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:08.541716 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:08.613048 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f970bcdb-683e-4f09-b872-4ab56c556dfb None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:08.617954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25e3c3e4-6ac8-47d4-98ca-9a8d35264f0f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:08.618525 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c3e4-6ac8-47d4-98ca-9a8d35264f0f service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:08.618809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c3e4-6ac8-47d4-98ca-9a8d35264f0f service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:08.619079 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25e3c3e4-6ac8-47d4-98ca-9a8d35264f0f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:08.621704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-25e3c3e4-6ac8-47d4-98ca-9a8d35264f0f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:08.632720 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3c3e4-6ac8-47d4-98ca-9a8d35264f0f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:08.634314 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25e3c3e4-6ac8-47d4-98ca-9a8d35264f0f service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:08.644820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1386/2803] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:45:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 124 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:45:13.478850 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=28 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:18.640660 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=34 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:29.365593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ab4a4-0eb9-4a10-950c-181dabda15a6 service cinder] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:29.427339 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942ab4a4-0eb9-4a10-950c-181dabda15a6 service cinder] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:29.431823 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:29.432825 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:29.433098 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:29.433364 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] PATH_INFO: `/v3/users/5c45f192ca374b99aa2b040f3ddb59f3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:29.434570 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c45f192ca374b99aa2b040f3ddb59f3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:29.436505 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:29.482190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c45f192ca374b99aa2b040f3ddb59f3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:29.488834 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c45f192ca374b99aa2b040f3ddb59f3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:29.496128 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c45f192ca374b99aa2b040f3ddb59f3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:29.508129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c45f192ca374b99aa2b040f3ddb59f3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:29.508696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c45f192ca374b99aa2b040f3ddb59f3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:29.516403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1418/2804] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:45:29 2022] DELETE /identity/v3/users/5c45f192ca374b99aa2b040f3ddb59f3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:45:29.521263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546060e-ede3-482e-8541-2d7809650fda None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:29.521771 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546060e-ede3-482e-8541-2d7809650fda None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:29.521876 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1546060e-ede3-482e-8541-2d7809650fda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:29.540268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-1546060e-ede3-482e-8541-2d7809650fda None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:29.542678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1546060e-ede3-482e-8541-2d7809650fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:29.601009 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1387/2805] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:29.611770 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:29.613157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:29.668977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-269936d2-fd32-4e62-a212-e36dda72f999 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:29.672578 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbffac8-e367-490b-998a-7c8a2eacd494 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:29.673207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffac8-e367-490b-998a-7c8a2eacd494 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:29.673510 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffac8-e367-490b-998a-7c8a2eacd494 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:29.673785 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbffac8-e367-490b-998a-7c8a2eacd494 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:29.682662 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbffac8-e367-490b-998a-7c8a2eacd494 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:29.684075 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fbffac8-e367-490b-998a-7c8a2eacd494 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:29.693367 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1419/2806] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:45:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:45:29.959024 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546060e-ede3-482e-8541-2d7809650fda None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:29.960648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-1546060e-ede3-482e-8541-2d7809650fda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:29.975575 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1546060e-ede3-482e-8541-2d7809650fda None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:29.981132 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:29.982098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:29.982381 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:29.982673 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] PATH_INFO: `/v3/projects/f18a9d49a3404c04bdbf3197a59bc390` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:29.983834 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] RBAC: Authorizing `identity:delete_project(project_id=f18a9d49a3404c04bdbf3197a59bc390)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:29.985786 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.033307 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f18a9d49a3404c04bdbf3197a59bc390', 'request_id': 'req-ba4a1487-5de1-473c-b931-52be89f22aae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:30.039462 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f18a9d49a3404c04bdbf3197a59bc390', 'request_id': 'req-ba4a1487-5de1-473c-b931-52be89f22aae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:30.047883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f18a9d49a3404c04bdbf3197a59bc390', 'request_id': 'req-ba4a1487-5de1-473c-b931-52be89f22aae'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:30.059887 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] The token cache is being invalidate because project f18a9d49a3404c04bdbf3197a59bc390 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:45:30.060174 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:30.060820 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-ba4a1487-5de1-473c-b931-52be89f22aae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:45:30.062400 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1388/2807] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:45:29 2022] DELETE /identity/v3/projects/f18a9d49a3404c04bdbf3197a59bc390 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:45:30.067222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f55f5-980b-44e1-8d3a-75a00a620158 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.067586 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f55f5-980b-44e1-8d3a-75a00a620158 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.067943 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3f55f5-980b-44e1-8d3a-75a00a620158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.086927 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-1f3f55f5-980b-44e1-8d3a-75a00a620158 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:30.089066 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-1f3f55f5-980b-44e1-8d3a-75a00a620158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:30.106108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:30.152286 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1420/2808] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:30.160098 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b863-42d9-4b4a-a840-e36959792d0a None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.160498 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b863-42d9-4b4a-a840-e36959792d0a None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.160873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7699b863-42d9-4b4a-a840-e36959792d0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.180508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7699b863-42d9-4b4a-a840-e36959792d0a None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:30.182881 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7699b863-42d9-4b4a-a840-e36959792d0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:30.192685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1389/2809] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:30.198302 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f55f5-980b-44e1-8d3a-75a00a620158 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:30.217687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3f55f5-980b-44e1-8d3a-75a00a620158 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:30.221390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:30.222219 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.222506 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.222781 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.223571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:45:30.223875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:30.225592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.240200 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1421/2810] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:45:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:45:30.246812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b863-42d9-4b4a-a840-e36959792d0a None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:30.257028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7699b863-42d9-4b4a-a840-e36959792d0a None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:30.262126 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37614080-b575-4300-98e0-ff5a08023798 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:30.262866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614080-b575-4300-98e0-ff5a08023798 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.263218 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614080-b575-4300-98e0-ff5a08023798 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.263618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37614080-b575-4300-98e0-ff5a08023798 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.264357 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37614080-b575-4300-98e0-ff5a08023798 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:30.266342 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37614080-b575-4300-98e0-ff5a08023798 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.293355 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1390/2811] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:45:30 2022] POST /identity/v3/projects => generated 371 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:45:30.297477 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:30.307297 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbf311c0-e227-44e7-a90d-e56021b87d71 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:30.362876 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b5a5b-5791-4517-800b-d51bde3b42f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:30.363592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b5a5b-5791-4517-800b-d51bde3b42f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.363874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b5a5b-5791-4517-800b-d51bde3b42f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.364151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-587b5a5b-5791-4517-800b-d51bde3b42f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.364833 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b5a5b-5791-4517-800b-d51bde3b42f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:30.366780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-587b5a5b-5791-4517-800b-d51bde3b42f1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.391607 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1422/2812] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:45:30 2022] POST /identity/v3/users => generated 286 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:45:30.392788 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37614080-b575-4300-98e0-ff5a08023798 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:30.403930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37614080-b575-4300-98e0-ff5a08023798 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:30.409263 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfcc65-06e0-4b22-b829-519c3d3f454f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:30.409985 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcc65-06e0-4b22-b829-519c3d3f454f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.410269 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcc65-06e0-4b22-b829-519c3d3f454f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.410544 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abfcc65-06e0-4b22-b829-519c3d3f454f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.411273 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfcc65-06e0-4b22-b829-519c3d3f454f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:30.412859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abfcc65-06e0-4b22-b829-519c3d3f454f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.426953 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1391/2813] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:45:30.428593 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b5a5b-5791-4517-800b-d51bde3b42f1 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:30.440342 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-587b5a5b-5791-4517-800b-d51bde3b42f1 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:30.445329 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d92a79-aa40-49f6-a69d-e4b73e079a7f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:30.446022 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d92a79-aa40-49f6-a69d-e4b73e079a7f admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.446301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d92a79-aa40-49f6-a69d-e4b73e079a7f admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.446573 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d92a79-aa40-49f6-a69d-e4b73e079a7f admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.447298 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d92a79-aa40-49f6-a69d-e4b73e079a7f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:30.448898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d92a79-aa40-49f6-a69d-e4b73e079a7f admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.459633 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1423/2814] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:45:30 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 12 08:45:30.464016 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfcc65-06e0-4b22-b829-519c3d3f454f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:30.473897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abfcc65-06e0-4b22-b829-519c3d3f454f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:30.479247 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:30.480304 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.480685 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.481028 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] PATH_INFO: `/v3/projects/bf1f0c1b90c64e3097bc040bff85b6e7/users/add953c622074717abe8230807229685/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.495967 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf1f0c1b90c64e3097bc040bff85b6e7, user_id=add953c622074717abe8230807229685, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:30.498853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.512550 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1392/2815] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:45:30 2022] PUT /identity/v3/projects/bf1f0c1b90c64e3097bc040bff85b6e7/users/add953c622074717abe8230807229685/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:45:30.517824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7bde9-28d8-46eb-a0a1-63e05374f7ac None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.518114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7bde9-28d8-46eb-a0a1-63e05374f7ac None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.518390 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f7bde9-28d8-46eb-a0a1-63e05374f7ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.537945 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-99f7bde9-28d8-46eb-a0a1-63e05374f7ac None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:30.539157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-99f7bde9-28d8-46eb-a0a1-63e05374f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:30.600982 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1424/2816] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:30.610634 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:30.612424 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:30.634483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:30.672872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-699a39b8-d031-45dd-b704-2a1dfd3569db admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:30.676406 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a37d5198-4dcb-49e3-865f-a9836dd62f48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:30.677046 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5198-4dcb-49e3-865f-a9836dd62f48 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.677334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5198-4dcb-49e3-865f-a9836dd62f48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.677631 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a37d5198-4dcb-49e3-865f-a9836dd62f48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.686764 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d5198-4dcb-49e3-865f-a9836dd62f48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:30.688191 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a37d5198-4dcb-49e3-865f-a9836dd62f48 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.699616 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1393/2817] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:45:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:45:30.727054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7bde9-28d8-46eb-a0a1-63e05374f7ac None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:30.728642 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-99f7bde9-28d8-46eb-a0a1-63e05374f7ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:30.740917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f7bde9-28d8-46eb-a0a1-63e05374f7ac None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:30.744668 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:30.745372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:30.745699 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:30.745969 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:30.748088 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:30.778550 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:30.821054 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:30.822529 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:30.833580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1425/2818] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:45:30 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:45:31.345946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81916b-90ba-4b5f-acbb-252804f3cc12 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:31.345946 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81916b-90ba-4b5f-acbb-252804f3cc12 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:31.346242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba81916b-90ba-4b5f-acbb-252804f3cc12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:31.378980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ba81916b-90ba-4b5f-acbb-252804f3cc12 None None] MFA Rules not processed for user `add953c622074717abe8230807229685`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:31.380106 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ba81916b-90ba-4b5f-acbb-252804f3cc12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:31.464280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1394/2819] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:31.474776 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:45:31.476673 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:31.564322 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc5d9f-23f0-462b-b8c2-d27144bc80d0 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:45:31.567924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16362b72-3a3f-4960-bf2f-76862eb56033 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:45:31.568559 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362b72-3a3f-4960-bf2f-76862eb56033 service cinder] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:31.568838 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362b72-3a3f-4960-bf2f-76862eb56033 service cinder] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:31.569102 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16362b72-3a3f-4960-bf2f-76862eb56033 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:31.578577 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362b72-3a3f-4960-bf2f-76862eb56033 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:45:31.580005 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16362b72-3a3f-4960-bf2f-76862eb56033 service cinder] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:45:31.589585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1426/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:45:31 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:45:33.996225 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87112b-6093-40b9-90db-7944c7668347 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:33.996811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87112b-6093-40b9-90db-7944c7668347 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:33.996811 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd87112b-6093-40b9-90db-7944c7668347 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:34.015430 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-bd87112b-6093-40b9-90db-7944c7668347 None None] MFA Rules not processed for user `add953c622074717abe8230807229685`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:34.016714 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-bd87112b-6093-40b9-90db-7944c7668347 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:34.023849 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1395/2821] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:33 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:41.584964 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=52 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:44.008867 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=52 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:45:51.331869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c459-63f9-4b05-ad91-827abb36aa28 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:51.332338 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c459-63f9-4b05-ad91-827abb36aa28 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:51.332517 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864c459-63f9-4b05-ad91-827abb36aa28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:51.350483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-3864c459-63f9-4b05-ad91-827abb36aa28 None None] MFA Rules not processed for user `aea4a7d869114dada57c45dc2129090b`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:51.351672 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3864c459-63f9-4b05-ad91-827abb36aa28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:51.406509 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1427/2822] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:51 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:45:55.426941 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77df67-ea03-44ff-b516-1e6c7799c161 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:45:55.427463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77df67-ea03-44ff-b516-1e6c7799c161 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:45:55.427559 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a77df67-ea03-44ff-b516-1e6c7799c161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:45:55.445670 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-9a77df67-ea03-44ff-b516-1e6c7799c161 None None] MFA Rules not processed for user `add953c622074717abe8230807229685`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:45:55.446966 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a77df67-ea03-44ff-b516-1e6c7799c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:45:55.455313 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1396/2823] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:45:55 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:01.398571 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=25 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:05.440379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:21.451712 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658552-b642-4d09-810f-f6bc356a6980 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:21.452211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658552-b642-4d09-810f-f6bc356a6980 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:21.452316 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93658552-b642-4d09-810f-f6bc356a6980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:21.479540 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-93658552-b642-4d09-810f-f6bc356a6980 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:21.481515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-93658552-b642-4d09-810f-f6bc356a6980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:21.552241 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1428/2824] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:46:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:21.597983 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77df67-ea03-44ff-b516-1e6c7799c161 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:21.599372 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-9a77df67-ea03-44ff-b516-1e6c7799c161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:21.666103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a77df67-ea03-44ff-b516-1e6c7799c161 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:21.671483 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44fe58-07db-4b7d-99e8-1ccd4e8f516b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:21.672118 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44fe58-07db-4b7d-99e8-1ccd4e8f516b service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:21.672401 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44fe58-07db-4b7d-99e8-1ccd4e8f516b service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:21.672675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d44fe58-07db-4b7d-99e8-1ccd4e8f516b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:21.680553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44fe58-07db-4b7d-99e8-1ccd4e8f516b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:21.682151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d44fe58-07db-4b7d-99e8-1ccd4e8f516b service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:21.690585 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1397/2825] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:46:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:46:31.545863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=32 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:31.687395 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=32 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:37.409172 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9748e7-be6d-45e8-9e42-9d78dd9f8ec4 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:37.409748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9748e7-be6d-45e8-9e42-9d78dd9f8ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:37.409748 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9748e7-be6d-45e8-9e42-9d78dd9f8ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:37.427910 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-aa9748e7-be6d-45e8-9e42-9d78dd9f8ec4 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:37.429108 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-aa9748e7-be6d-45e8-9e42-9d78dd9f8ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:37.436848 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1429/2826] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 12 08:46:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:37.449805 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44fe58-07db-4b7d-99e8-1ccd4e8f516b service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:37.460476 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d44fe58-07db-4b7d-99e8-1ccd4e8f516b service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:37.466199 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad063bb4-0c0d-494c-89d4-28b903ec3499 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:37.466830 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad063bb4-0c0d-494c-89d4-28b903ec3499 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:37.467113 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad063bb4-0c0d-494c-89d4-28b903ec3499 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:37.467392 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad063bb4-0c0d-494c-89d4-28b903ec3499 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:37.475433 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad063bb4-0c0d-494c-89d4-28b903ec3499 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:37.477005 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad063bb4-0c0d-494c-89d4-28b903ec3499 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:37.485633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1398/2827] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:46:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:46:39.418417 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9748e7-be6d-45e8-9e42-9d78dd9f8ec4 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:39.430061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9748e7-be6d-45e8-9e42-9d78dd9f8ec4 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:39.435690 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:39.436558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:39.436857 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:39.437114 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] PATH_INFO: `/v3/users/add953c622074717abe8230807229685` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:39.438306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=add953c622074717abe8230807229685)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:39.440248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:39.484957 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'add953c622074717abe8230807229685'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.491661 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'add953c622074717abe8230807229685'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.499406 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'add953c622074717abe8230807229685'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.511379 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'add953c622074717abe8230807229685'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.512122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-cde32117-5e00-48c9-9199-31a69c2dcde2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'add953c622074717abe8230807229685'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.521489 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1430/2828] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:46:39 2022] DELETE /identity/v3/users/add953c622074717abe8230807229685 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:46:39.686510 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad063bb4-0c0d-494c-89d4-28b903ec3499 service swift] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:39.696932 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad063bb4-0c0d-494c-89d4-28b903ec3499 service swift] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:39.755389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:39.756252 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:39.756533 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:39.756809 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] PATH_INFO: `/v3/projects/bf1f0c1b90c64e3097bc040bff85b6e7` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:39.758052 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf1f0c1b90c64e3097bc040bff85b6e7)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:39.759979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:39.806349 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf1f0c1b90c64e3097bc040bff85b6e7', 'request_id': 'req-f68e3802-f686-45fa-b210-4d5f305c09a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.812900 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf1f0c1b90c64e3097bc040bff85b6e7', 'request_id': 'req-f68e3802-f686-45fa-b210-4d5f305c09a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.819412 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf1f0c1b90c64e3097bc040bff85b6e7', 'request_id': 'req-f68e3802-f686-45fa-b210-4d5f305c09a4'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.834564 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] The token cache is being invalidate because project bf1f0c1b90c64e3097bc040bff85b6e7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:46:39.834838 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.835508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-f68e3802-f686-45fa-b210-4d5f305c09a4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:39.837157 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1399/2829] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:46:39 2022] DELETE /identity/v3/projects/bf1f0c1b90c64e3097bc040bff85b6e7 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:46:39.842731 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc651e-e94a-4a74-ba44-d3d474ff0070 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:39.843105 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc651e-e94a-4a74-ba44-d3d474ff0070 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:39.843432 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dc651e-e94a-4a74-ba44-d3d474ff0070 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:39.861931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-d1dc651e-e94a-4a74-ba44-d3d474ff0070 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:39.863117 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-d1dc651e-e94a-4a74-ba44-d3d474ff0070 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:39.923428 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1431/2830] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:39.931588 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe276be-01b4-49c9-8ba9-5acb266cd03e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:39.931872 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe276be-01b4-49c9-8ba9-5acb266cd03e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:39.932150 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe276be-01b4-49c9-8ba9-5acb266cd03e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:39.951655 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-7fe276be-01b4-49c9-8ba9-5acb266cd03e None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:39.952877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7fe276be-01b4-49c9-8ba9-5acb266cd03e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:39.960810 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1400/2831] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:46:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:39.965387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc651e-e94a-4a74-ba44-d3d474ff0070 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:39.975260 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dc651e-e94a-4a74-ba44-d3d474ff0070 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:39.979760 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:39.981073 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:39.981582 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:39.981874 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:39.982588 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:46:39.982886 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:39.984649 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:39.996119 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1432/2832] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:46:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:46:40.001780 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe276be-01b4-49c9-8ba9-5acb266cd03e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:40.010916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe276be-01b4-49c9-8ba9-5acb266cd03e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:40.017151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414e199-ac60-4d83-aa94-11b622492eb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:40.018291 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414e199-ac60-4d83-aa94-11b622492eb5 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.018562 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414e199-ac60-4d83-aa94-11b622492eb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.018843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9414e199-ac60-4d83-aa94-11b622492eb5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.020003 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414e199-ac60-4d83-aa94-11b622492eb5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:40.022190 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9414e199-ac60-4d83-aa94-11b622492eb5 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:40.058882 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1401/2833] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:46:40 2022] POST /identity/v3/projects => generated 369 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:46:40.063299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:40.073127 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db69d129-e467-49ff-8693-80ac559f8a49 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:40.119869 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:40.130236 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800afead-e44b-4d9c-8608-681a7f1c49c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:40.130928 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afead-e44b-4d9c-8608-681a7f1c49c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.131214 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afead-e44b-4d9c-8608-681a7f1c49c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.131488 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800afead-e44b-4d9c-8608-681a7f1c49c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.132188 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800afead-e44b-4d9c-8608-681a7f1c49c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:40.134139 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800afead-e44b-4d9c-8608-681a7f1c49c8 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:40.158359 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1433/2834] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:46:40 2022] POST /identity/v3/users => generated 285 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:46:40.159568 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414e199-ac60-4d83-aa94-11b622492eb5 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:40.169910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9414e199-ac60-4d83-aa94-11b622492eb5 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:40.174613 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d45d4-795f-4d41-82f3-80b161965655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:40.175211 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d45d4-795f-4d41-82f3-80b161965655 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.175493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d45d4-795f-4d41-82f3-80b161965655 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.175787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd5d45d4-795f-4d41-82f3-80b161965655 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.176484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d45d4-795f-4d41-82f3-80b161965655 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:40.178144 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd5d45d4-795f-4d41-82f3-80b161965655 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:40.187973 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1402/2835] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:46:40.191814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800afead-e44b-4d9c-8608-681a7f1c49c8 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:40.202296 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800afead-e44b-4d9c-8608-681a7f1c49c8 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:40.206830 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d8a0a94-f4fc-41af-a1de-a6d8a47b71b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:40.207484 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0a94-f4fc-41af-a1de-a6d8a47b71b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.207766 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0a94-f4fc-41af-a1de-a6d8a47b71b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.208041 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8a0a94-f4fc-41af-a1de-a6d8a47b71b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.208761 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a0a94-f4fc-41af-a1de-a6d8a47b71b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:40.210387 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d8a0a94-f4fc-41af-a1de-a6d8a47b71b1 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:40.220153 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1434/2836] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:46:40 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:46:40.224036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d45d4-795f-4d41-82f3-80b161965655 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:40.234586 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd5d45d4-795f-4d41-82f3-80b161965655 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:40.239094 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:40.239949 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.240232 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.240501 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] PATH_INFO: `/v3/projects/24e80f4f0cd74fb1b302e7fa4ec6b51c/users/60d074c3f623487e9153192ffc0c4b40/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.255209 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] RBAC: Authorizing `identity:create_grant(project_id=24e80f4f0cd74fb1b302e7fa4ec6b51c, user_id=60d074c3f623487e9153192ffc0c4b40, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:40.258096 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:40.272035 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1403/2837] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:46:40 2022] PUT /identity/v3/projects/24e80f4f0cd74fb1b302e7fa4ec6b51c/users/60d074c3f623487e9153192ffc0c4b40/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:46:40.282483 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b6abf-81bd-463b-9b68-954bd82455b6 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.282777 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b6abf-81bd-463b-9b68-954bd82455b6 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.283154 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e15b6abf-81bd-463b-9b68-954bd82455b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.310767 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-e15b6abf-81bd-463b-9b68-954bd82455b6 None None] MFA Rules not processed for user `60d074c3f623487e9153192ffc0c4b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:40.311966 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-e15b6abf-81bd-463b-9b68-954bd82455b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:40.374565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1435/2838] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:46:40 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:40.385666 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:40.387428 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:40.393930 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:40.450322 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d1520e-5dc1-4d61-a9f9-cc1d06063edd admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:40.453929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52d5866c-44f4-4766-8160-5536af4fd52f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '91d8f3d11ef745d988fa2749f2a885ee', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:40.454570 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5866c-44f4-4766-8160-5536af4fd52f service cinder] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.454853 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5866c-44f4-4766-8160-5536af4fd52f service cinder] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.455128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52d5866c-44f4-4766-8160-5536af4fd52f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.463254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5866c-44f4-4766-8160-5536af4fd52f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:40.464720 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52d5866c-44f4-4766-8160-5536af4fd52f service cinder] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:40.473743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1404/2839] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:46:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:46:40.498892 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b6abf-81bd-463b-9b68-954bd82455b6 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:40.559694 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e15b6abf-81bd-463b-9b68-954bd82455b6 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:40.564157 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:40.565007 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.565283 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.565580 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] PATH_INFO: `/v3/users/60d074c3f623487e9153192ffc0c4b40` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.566747 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] RBAC: Authorizing `identity:delete_user(user_id=60d074c3f623487e9153192ffc0c4b40)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:40.568732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:40.612346 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60d074c3f623487e9153192ffc0c4b40'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:40.619528 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60d074c3f623487e9153192ffc0c4b40'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:40.626759 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60d074c3f623487e9153192ffc0c4b40'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:40.627959 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=88,keystone:INSERT=4,keystone:DELETE=8 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:40.643671 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60d074c3f623487e9153192ffc0c4b40'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:40.644358 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60d074c3f623487e9153192ffc0c4b40'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:40.650512 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1436/2840] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:46:40 2022] DELETE /identity/v3/users/60d074c3f623487e9153192ffc0c4b40 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:46:40.655658 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f37d-0db3-4ec0-afd5-3bfd6d28fae0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.655950 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f37d-0db3-4ec0-afd5-3bfd6d28fae0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.656229 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f825f37d-0db3-4ec0-afd5-3bfd6d28fae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.673563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-f825f37d-0db3-4ec0-afd5-3bfd6d28fae0 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:40.674755 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f825f37d-0db3-4ec0-afd5-3bfd6d28fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:40.733740 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1405/2841] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:46:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:40.743348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:40.744726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:40.801063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4d555-2ce9-4b82-b2a2-59ef9ca85847 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:40.804696 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:40.805334 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:40.805646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:40.805920 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:40.814821 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:40.816253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:40.825923 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1437/2842] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:46:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:46:41.106121 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f37d-0db3-4ec0-afd5-3bfd6d28fae0 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:41.107679 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f825f37d-0db3-4ec0-afd5-3bfd6d28fae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:41.120076 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f825f37d-0db3-4ec0-afd5-3bfd6d28fae0 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:41.125627 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:41.126470 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:41.126749 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:41.127004 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] PATH_INFO: `/v3/projects/24e80f4f0cd74fb1b302e7fa4ec6b51c` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:41.128189 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=24e80f4f0cd74fb1b302e7fa4ec6b51c)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:41.130119 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:41.179822 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '24e80f4f0cd74fb1b302e7fa4ec6b51c', 'request_id': 'req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:41.186515 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '24e80f4f0cd74fb1b302e7fa4ec6b51c', 'request_id': 'req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:41.194485 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '24e80f4f0cd74fb1b302e7fa4ec6b51c', 'request_id': 'req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:41.205980 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] The token cache is being invalidate because project 24e80f4f0cd74fb1b302e7fa4ec6b51c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:46:41.206265 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:41.206885 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:41.208387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1406/2843] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:46:41 2022] DELETE /identity/v3/projects/24e80f4f0cd74fb1b302e7fa4ec6b51c => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:46:50.821440 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=33,keystone:DELETE=2 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:51.202933 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=78,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:52.134963 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:52.136423 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:52.150840 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795ca336-0fbc-443a-9031-1fee3542a8e6 service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:52.205566 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:52.206443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.206721 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.206992 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] PATH_INFO: `/v3/users/aea4a7d869114dada57c45dc2129090b` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.208174 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aea4a7d869114dada57c45dc2129090b)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:52.210118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:52.254459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aea4a7d869114dada57c45dc2129090b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.261061 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aea4a7d869114dada57c45dc2129090b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.268772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aea4a7d869114dada57c45dc2129090b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.281601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aea4a7d869114dada57c45dc2129090b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.282263 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-5ba05795-006c-43ca-9a5a-5bd1471e93c4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aea4a7d869114dada57c45dc2129090b'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.288151 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1438/2844] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:46:52 2022] DELETE /identity/v3/users/aea4a7d869114dada57c45dc2129090b => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:46:52.456609 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:52.458133 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:52.473034 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbfcf8d7-ac87-4d38-a034-d6cc9e24d8e7 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:52.532894 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:52.533787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.534072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.534347 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] PATH_INFO: `/v3/projects/b4fc581ecf394774ab77a0431a98c572` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.535520 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] RBAC: Authorizing `identity:delete_project(project_id=b4fc581ecf394774ab77a0431a98c572)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:52.537431 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:52.583318 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b4fc581ecf394774ab77a0431a98c572', 'request_id': 'req-8360b175-f446-4ec4-bfd5-20bd0e0848ca'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.588730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b4fc581ecf394774ab77a0431a98c572', 'request_id': 'req-8360b175-f446-4ec4-bfd5-20bd0e0848ca'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.596430 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b4fc581ecf394774ab77a0431a98c572', 'request_id': 'req-8360b175-f446-4ec4-bfd5-20bd0e0848ca'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.607784 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] The token cache is being invalidate because project b4fc581ecf394774ab77a0431a98c572 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:46:52.608074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.608706 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-8360b175-f446-4ec4-bfd5-20bd0e0848ca admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:46:52.610280 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1407/2845] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:46:52 2022] DELETE /identity/v3/projects/b4fc581ecf394774ab77a0431a98c572 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:46:52.615158 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db754f3-8c4e-42a4-a16e-12ffca0b2bfd None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.615482 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db754f3-8c4e-42a4-a16e-12ffca0b2bfd None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.615752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5db754f3-8c4e-42a4-a16e-12ffca0b2bfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.635109 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-5db754f3-8c4e-42a4-a16e-12ffca0b2bfd None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:52.636317 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-5db754f3-8c4e-42a4-a16e-12ffca0b2bfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:52.698069 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1439/2846] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:52.706140 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd41a-e39e-4ef4-84b0-55f4c6834628 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.706417 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd41a-e39e-4ef4-84b0-55f4c6834628 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.706694 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c34cd41a-e39e-4ef4-84b0-55f4c6834628 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.726072 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-c34cd41a-e39e-4ef4-84b0-55f4c6834628 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:52.727305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c34cd41a-e39e-4ef4-84b0-55f4c6834628 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:52.735918 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1408/2847] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:46:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:52.740572 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db754f3-8c4e-42a4-a16e-12ffca0b2bfd None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:52.750898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5db754f3-8c4e-42a4-a16e-12ffca0b2bfd None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:52.755575 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:52.756248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.756533 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.756809 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] PATH_INFO: `/v3/domains` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.757682 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80191) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 12 08:46:52.757991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:52.760279 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:52.776641 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1440/2848] 10.222.0.20 () {58 vars in 1152 bytes} [Tue Jul 12 08:46:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 12 08:46:52.778234 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd41a-e39e-4ef4-84b0-55f4c6834628 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:52.787891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c34cd41a-e39e-4ef4-84b0-55f4c6834628 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:52.792535 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e7f4b-9cd0-494b-9921-a9d806a76027 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:52.793833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7f4b-9cd0-494b-9921-a9d806a76027 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.793833 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7f4b-9cd0-494b-9921-a9d806a76027 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.794513 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c7e7f4b-9cd0-494b-9921-a9d806a76027 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.795070 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e7f4b-9cd0-494b-9921-a9d806a76027 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:52.797000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c7e7f4b-9cd0-494b-9921-a9d806a76027 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:52.826667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1409/2849] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:46:52 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:46:52.829904 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:52.840730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e2dcc4-6d95-473e-81eb-8d4d29671bda admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:52.844613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:52.904047 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1743347-e905-43e8-8daf-9d734e9868b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:52.904718 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1743347-e905-43e8-8daf-9d734e9868b5 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.904997 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1743347-e905-43e8-8daf-9d734e9868b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.905267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1743347-e905-43e8-8daf-9d734e9868b5 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.905991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1743347-e905-43e8-8daf-9d734e9868b5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:52.907898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1743347-e905-43e8-8daf-9d734e9868b5 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:52.932112 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1441/2850] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:46:52 2022] POST /identity/v3/users => generated 292 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 12 08:46:52.933391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e7f4b-9cd0-494b-9921-a9d806a76027 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:52.944054 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c7e7f4b-9cd0-494b-9921-a9d806a76027 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:52.948643 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c165b2-0333-4a33-8f4a-9866d134982f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:52.949877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c165b2-0333-4a33-8f4a-9866d134982f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.950243 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c165b2-0333-4a33-8f4a-9866d134982f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.950697 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c165b2-0333-4a33-8f4a-9866d134982f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.951426 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c165b2-0333-4a33-8f4a-9866d134982f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:52.953029 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c165b2-0333-4a33-8f4a-9866d134982f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:52.963425 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1410/2851] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:46:52.968530 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1743347-e905-43e8-8daf-9d734e9868b5 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:52.978753 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1743347-e905-43e8-8daf-9d734e9868b5 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:52.983404 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc691e8f-76e7-414d-80c1-543bf8f1785b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:52.984162 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691e8f-76e7-414d-80c1-543bf8f1785b admin admin] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:52.984518 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691e8f-76e7-414d-80c1-543bf8f1785b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:52.984839 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc691e8f-76e7-414d-80c1-543bf8f1785b admin admin] PATH_INFO: `/v3/roles` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:52.985591 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc691e8f-76e7-414d-80c1-543bf8f1785b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:52.987176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc691e8f-76e7-414d-80c1-543bf8f1785b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:52.997666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1442/2852] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:46:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:46:53.001699 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c165b2-0333-4a33-8f4a-9866d134982f admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:53.012386 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c165b2-0333-4a33-8f4a-9866d134982f admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:53.016923 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:53.017917 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:53.018202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:53.019087 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] PATH_INFO: `/v3/projects/efce4a5c7d7b40ca9fe23b3fe62e4982/users/479ad69bab3e44dc86f856566b5239a3/roles/672aed7af8e9436a801cd1eca8806cce` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:53.034763 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=efce4a5c7d7b40ca9fe23b3fe62e4982, user_id=479ad69bab3e44dc86f856566b5239a3, role_id=672aed7af8e9436a801cd1eca8806cce)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:53.037344 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:53.050320 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1411/2853] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:46:53 2022] PUT /identity/v3/projects/efce4a5c7d7b40ca9fe23b3fe62e4982/users/479ad69bab3e44dc86f856566b5239a3/roles/672aed7af8e9436a801cd1eca8806cce => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:46:53.055393 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762eb0-03e0-4629-a0ff-e9a3aa3cf4f1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:53.055680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762eb0-03e0-4629-a0ff-e9a3aa3cf4f1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:53.055977 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42762eb0-03e0-4629-a0ff-e9a3aa3cf4f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:53.073043 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-42762eb0-03e0-4629-a0ff-e9a3aa3cf4f1 None None] MFA Rules not processed for user `a284f7c10ba148eab43b0163d0db6ba7`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:53.074755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-42762eb0-03e0-4629-a0ff-e9a3aa3cf4f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:53.137558 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1443/2854] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:46:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 12 08:46:53.144695 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:53.146388 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:53.179334 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:53.207947 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce541409-4b2e-4a55-bdb5-df9ebd5f66c2 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:53.211688 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed69c9e-bbf6-43e5-a192-1247a352046f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:53.212332 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69c9e-bbf6-43e5-a192-1247a352046f service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:53.212648 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69c9e-bbf6-43e5-a192-1247a352046f service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:53.212875 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ed69c9e-bbf6-43e5-a192-1247a352046f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:53.223305 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed69c9e-bbf6-43e5-a192-1247a352046f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:53.224873 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ed69c9e-bbf6-43e5-a192-1247a352046f service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:53.234801 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1412/2855] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:46:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:46:57.237191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e13f5f-b726-4b9e-9708-5b006ed9f955 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:57.237794 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e13f5f-b726-4b9e-9708-5b006ed9f955 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:57.237906 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0e13f5f-b726-4b9e-9708-5b006ed9f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:57.267394 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c0e13f5f-b726-4b9e-9708-5b006ed9f955 None None] MFA Rules not processed for user `479ad69bab3e44dc86f856566b5239a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:46:57.268630 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c0e13f5f-b726-4b9e-9708-5b006ed9f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:46:57.337991 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1444/2856] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:46:57 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:46:57.342877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed69c9e-bbf6-43e5-a192-1247a352046f service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:57.352415 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ed69c9e-bbf6-43e5-a192-1247a352046f service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:57.357916 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303d0c-83f9-4494-9856-40a86acf5849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:57.358593 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303d0c-83f9-4494-9856-40a86acf5849 admin admin] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:57.358884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303d0c-83f9-4494-9856-40a86acf5849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:57.359159 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b303d0c-83f9-4494-9856-40a86acf5849 admin admin] PATH_INFO: `/v3/projects` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:57.359910 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b303d0c-83f9-4494-9856-40a86acf5849 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:57.361798 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b303d0c-83f9-4494-9856-40a86acf5849 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:57.390036 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1413/2857] 10.222.0.20 () {60 vars in 1152 bytes} [Tue Jul 12 08:46:57 2022] POST /identity/v3/projects => generated 383 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:46:57.394000 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e13f5f-b726-4b9e-9708-5b006ed9f955 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:57.405325 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0e13f5f-b726-4b9e-9708-5b006ed9f955 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:57.423126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:46:57.472592 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862563f-261e-4137-bc64-90ad66f32900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:57.473493 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862563f-261e-4137-bc64-90ad66f32900 admin admin] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:57.473779 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862563f-261e-4137-bc64-90ad66f32900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:57.474048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4862563f-261e-4137-bc64-90ad66f32900 admin admin] PATH_INFO: `/v3/users` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:57.474774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862563f-261e-4137-bc64-90ad66f32900 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:57.476755 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4862563f-261e-4137-bc64-90ad66f32900 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:57.500752 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1445/2858] 10.222.0.20 () {60 vars in 1143 bytes} [Tue Jul 12 08:46:57 2022] POST /identity/v3/users => generated 298 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 12 08:46:57.502063 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303d0c-83f9-4494-9856-40a86acf5849 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:57.513986 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b303d0c-83f9-4494-9856-40a86acf5849 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:57.519290 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c3be6-00fd-43eb-8d6a-41904477a965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:57.519964 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3be6-00fd-43eb-8d6a-41904477a965 admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:57.520242 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3be6-00fd-43eb-8d6a-41904477a965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:57.520531 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da6c3be6-00fd-43eb-8d6a-41904477a965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:57.521254 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c3be6-00fd-43eb-8d6a-41904477a965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:57.522886 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da6c3be6-00fd-43eb-8d6a-41904477a965 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:57.534859 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1414/2859] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:46:57.539222 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862563f-261e-4137-bc64-90ad66f32900 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:57.550294 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4862563f-261e-4137-bc64-90ad66f32900 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:57.555002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc607b-7e6d-44b2-8726-139140a1af2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:57.555890 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc607b-7e6d-44b2-8726-139140a1af2d admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:57.556165 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc607b-7e6d-44b2-8726-139140a1af2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:57.556434 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76fc607b-7e6d-44b2-8726-139140a1af2d admin admin] PATH_INFO: `/v3/projects/7b6e89f170ab48f0a9bbab07a6cc0075/users/24a4473ae8004ebd95a08fbebe479668/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:57.575215 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc607b-7e6d-44b2-8726-139140a1af2d admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6e89f170ab48f0a9bbab07a6cc0075, user_id=24a4473ae8004ebd95a08fbebe479668, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:57.578468 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76fc607b-7e6d-44b2-8726-139140a1af2d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:57.595024 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1446/2860] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:46:57 2022] PUT /identity/v3/projects/7b6e89f170ab48f0a9bbab07a6cc0075/users/24a4473ae8004ebd95a08fbebe479668/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:46:57.598855 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c3be6-00fd-43eb-8d6a-41904477a965 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:57.609791 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da6c3be6-00fd-43eb-8d6a-41904477a965 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:57.670279 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a859103-ac5b-4e8b-9713-91fc3e383f2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:57.670945 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859103-ac5b-4e8b-9713-91fc3e383f2f admin admin] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:57.671222 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859103-ac5b-4e8b-9713-91fc3e383f2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:57.671493 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a859103-ac5b-4e8b-9713-91fc3e383f2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:57.672210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a859103-ac5b-4e8b-9713-91fc3e383f2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:57.673842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a859103-ac5b-4e8b-9713-91fc3e383f2f admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:57.685000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1415/2861] 10.222.0.20 () {58 vars in 1121 bytes} [Tue Jul 12 08:46:57 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 12 08:46:57.689186 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc607b-7e6d-44b2-8726-139140a1af2d admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:46:57.700692 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76fc607b-7e6d-44b2-8726-139140a1af2d admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:46:57.705269 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:46:57.706240 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] REQUEST_METHOD: `PUT` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:46:57.706663 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:46:57.706940 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] PATH_INFO: `/v3/projects/7b6e89f170ab48f0a9bbab07a6cc0075/users/24a4473ae8004ebd95a08fbebe479668/roles/7d196c74e73c4a518f6152de7edeed12` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:46:57.708907 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b6e89f170ab48f0a9bbab07a6cc0075, user_id=24a4473ae8004ebd95a08fbebe479668, role_id=7d196c74e73c4a518f6152de7edeed12)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:46:57.711585 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:46:57.722730 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1447/2862] 10.222.0.20 () {60 vars in 1482 bytes} [Tue Jul 12 08:46:57 2022] PUT /identity/v3/projects/7b6e89f170ab48f0a9bbab07a6cc0075/users/24a4473ae8004ebd95a08fbebe479668/roles/7d196c74e73c4a518f6152de7edeed12 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 12 08:47:02.049622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a086-6cff-4eec-b574-a9665eee5ae0 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:02.050114 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a086-6cff-4eec-b574-a9665eee5ae0 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:02.050219 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea74a086-6cff-4eec-b574-a9665eee5ae0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:02.107575 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-ea74a086-6cff-4eec-b574-a9665eee5ae0 None None] MFA Rules not processed for user `24a4473ae8004ebd95a08fbebe479668`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:47:02.108841 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-ea74a086-6cff-4eec-b574-a9665eee5ae0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:02.227069 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1416/2863] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:47:02 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:47:02.240565 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:02.242348 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:02.319319 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9def26e9-4ee5-4a33-b515-d5a5d93f562b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:02.323306 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993e107cc04e4ce6b9abd9997c29381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:02.324632 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:02.325567 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:02.325864 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:02.400531 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:02.402137 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:02.413340 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1448/2864] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:47:02 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:47:02.518170 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913ca70-f489-418b-8d02-6a2757ad7150 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:02.518552 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913ca70-f489-418b-8d02-6a2757ad7150 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:02.518969 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6913ca70-f489-418b-8d02-6a2757ad7150 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:02.538297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-6913ca70-f489-418b-8d02-6a2757ad7150 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:47:02.539597 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-6913ca70-f489-418b-8d02-6a2757ad7150 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:02.553569 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:47:02.604274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1417/2865] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:47:02 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:47:02.617631 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:02.619106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:02.649378 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:47:02.696459 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b578ed-6d1d-45a5-827c-4edfc1e0eb50 service glance] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:02.702272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2ae62-a721-44e8-b401-cd384f03deb2 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:02.702916 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ae62-a721-44e8-b401-cd384f03deb2 service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:02.703197 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ae62-a721-44e8-b401-cd384f03deb2 service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:02.703471 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ab2ae62-a721-44e8-b401-cd384f03deb2 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:02.711917 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2ae62-a721-44e8-b401-cd384f03deb2 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:02.713508 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ab2ae62-a721-44e8-b401-cd384f03deb2 service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:02.722291 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1449/2866] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:47:02 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:47:11.420927 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e019c-4dcb-4749-a3d1-e68ab4c90a53 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:11.421449 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e019c-4dcb-4749-a3d1-e68ab4c90a53 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:11.421563 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-845e019c-4dcb-4749-a3d1-e68ab4c90a53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:11.438987 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-845e019c-4dcb-4749-a3d1-e68ab4c90a53 None None] MFA Rules not processed for user `479ad69bab3e44dc86f856566b5239a3`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:47:11.440165 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-845e019c-4dcb-4749-a3d1-e68ab4c90a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:11.447130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1418/2867] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:47:11 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:47:11.485646 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2ae62-a721-44e8-b401-cd384f03deb2 service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:11.494968 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ab2ae62-a721-44e8-b401-cd384f03deb2 service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:11.498773 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd3b2a9f-57f7-4ffb-b11e-c21776f94a5e service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '993e107cc04e4ce6b9abd9997c29381f', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:11.499399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b2a9f-57f7-4ffb-b11e-c21776f94a5e service glance] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:11.499674 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b2a9f-57f7-4ffb-b11e-c21776f94a5e service glance] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:11.499942 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3b2a9f-57f7-4ffb-b11e-c21776f94a5e service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:11.501678 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-cd3b2a9f-57f7-4ffb-b11e-c21776f94a5e service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:11.583931 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b2a9f-57f7-4ffb-b11e-c21776f94a5e service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:11.585368 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd3b2a9f-57f7-4ffb-b11e-c21776f94a5e service glance] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:11.606666 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1450/2868] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:47:11 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:47:12.152866 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e019c-4dcb-4749-a3d1-e68ab4c90a53 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:12.154309 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-845e019c-4dcb-4749-a3d1-e68ab4c90a53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:12.213844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-845e019c-4dcb-4749-a3d1-e68ab4c90a53 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:12.217391 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:12.218056 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:12.218389 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:12.218665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:12.220475 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:12.234787 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:12.236761 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:12.248327 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1419/2869] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:47:12 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:47:13.362343 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dceca-6aea-436f-913e-f5f8c19e2fd1 None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:13.362863 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dceca-6aea-436f-913e-f5f8c19e2fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:13.363330 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021dceca-6aea-436f-913e-f5f8c19e2fd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:13.433878 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-021dceca-6aea-436f-913e-f5f8c19e2fd1 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:47:13.435016 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-021dceca-6aea-436f-913e-f5f8c19e2fd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:13.452647 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1451/2870] 10.222.0.20 () {58 vars in 1009 bytes} [Tue Jul 12 08:47:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:47:13.467002 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:13.487743 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-875f6011-244c-426f-ab28-a244bf8d1041 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:13.492979 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6535f801-4063-421f-be73-6c2be7ddfc16 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:13.493649 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f801-4063-421f-be73-6c2be7ddfc16 service swift] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:13.493931 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f801-4063-421f-be73-6c2be7ddfc16 service swift] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:13.494205 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6535f801-4063-421f-be73-6c2be7ddfc16 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:13.503884 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535f801-4063-421f-be73-6c2be7ddfc16 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:13.505503 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6535f801-4063-421f-be73-6c2be7ddfc16 service swift] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:13.514492 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1420/2871] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:47:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:47:23.448897 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=83 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:47:23.510844 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=56 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:47:23.740400 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dceca-6aea-436f-913e-f5f8c19e2fd1 None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:23.749885 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021dceca-6aea-436f-913e-f5f8c19e2fd1 None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:23.753439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:23.754122 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:23.754405 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:23.754679 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:23.756443 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:23.766762 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:23.768198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:23.776552 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1452/2872] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:47:23 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:47:33.772698 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:47:34.689635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04992904-82cd-4417-a9cc-6afa7a7feb3e None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:34.690131 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04992904-82cd-4417-a9cc-6afa7a7feb3e None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:34.690236 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04992904-82cd-4417-a9cc-6afa7a7feb3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:34.708387 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-04992904-82cd-4417-a9cc-6afa7a7feb3e None None] MFA Rules not processed for user `0b215dd8b36942d291591d77dd661e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:47:34.709549 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-04992904-82cd-4417-a9cc-6afa7a7feb3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:34.769316 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1421/2873] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:47:34 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:47:35.520035 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:35.521553 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:35.591891 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0a11c6d-3522-4322-8d92-5e38b79c0c7f service neutron] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:35.596787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:35.597438 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:35.597732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:35.598011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:35.599796 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:35.612399 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:35.614437 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:35.624797 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1453/2874] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:47:35 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 105 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:47:40.441576 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04992904-82cd-4417-a9cc-6afa7a7feb3e None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:40.451733 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04992904-82cd-4417-a9cc-6afa7a7feb3e None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:40.455267 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:40.455929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:40.456212 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:40.456496 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:40.465808 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:40.467248 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:40.476491 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1422/2875] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:47:40 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:47:45.620118 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=32 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:47:48.434549 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:48.436018 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:48.451941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913d55b-5a1f-4de4-8b84-aeb067199b32 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:48.457737 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:48.458462 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:48.458814 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:48.459159 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:48.461015 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:48.478946 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:48.481030 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:48.493199 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1454/2876] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:47:48 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:47:50.472421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=31 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:47:52.627340 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:47:52.628836 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:52.645021 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a773e4-ceb2-4b7a-a510-f8d52509cc26 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:47:52.650542 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c42d64d-7a6e-4eff-95a7-ca50066d4368 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:47:52.651463 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d64d-7a6e-4eff-95a7-ca50066d4368 service nova] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:47:52.651730 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d64d-7a6e-4eff-95a7-ca50066d4368 service nova] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:47:52.652975 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c42d64d-7a6e-4eff-95a7-ca50066d4368 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:47:52.654897 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-7c42d64d-7a6e-4eff-95a7-ca50066d4368 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:47:52.667169 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42d64d-7a6e-4eff-95a7-ca50066d4368 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:47:52.669812 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c42d64d-7a6e-4eff-95a7-ca50066d4368 service nova] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:47:52.680653 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1423/2877] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:47:52 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:47:58.488253 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=6 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:48:02.676130 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=6 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:48:57.957048 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:48:57.976950 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62eda625-66d6-4863-8664-99aa44d04f6f service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:48:57.993201 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1fe88851e1154cf0838e0cbe47459156', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member', 'service', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:48:57.998082 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:48:57.998412 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:48:58.000866 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:48:58.003726 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:48:58.019487 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:48:58.020924 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:48:58.034176 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1455/2878] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:48:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 78 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:49:05.454843 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad330c9-eb4e-472f-8b1d-5662dd35b486 None None] REQUEST_METHOD: `POST` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:05.455317 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad330c9-eb4e-472f-8b1d-5662dd35b486 None None] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:05.455421 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad330c9-eb4e-472f-8b1d-5662dd35b486 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:05.472939 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.auth.core [None req-dad330c9-eb4e-472f-8b1d-5662dd35b486 None None] MFA Rules not processed for user `b46349b7039e4161ac7f9ac2e477a9d9`. Rule list: `[]` (Enabled: `True`). {{(pid=80192) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:49:05.474155 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dad330c9-eb4e-472f-8b1d-5662dd35b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:49:05.482068 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1424/2879] 10.222.0.20 () {58 vars in 967 bytes} [Tue Jul 12 08:49:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:49:05.521341 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:49:05.533772 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3557ce69-14da-4416-a374-6f57c3cb50ff service nova] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:49:05.538774 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e11fe7-e92e-4557-a15f-1832f752b32d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '5de7841acf434c53a3c17ee73fae76e0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:49:05.539403 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e11fe7-e92e-4557-a15f-1832f752b32d service swift] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:05.539681 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e11fe7-e92e-4557-a15f-1832f752b32d service swift] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:05.539954 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e11fe7-e92e-4557-a15f-1832f752b32d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:05.548408 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e11fe7-e92e-4557-a15f-1832f752b32d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:49:05.550037 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e11fe7-e92e-4557-a15f-1832f752b32d service swift] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:49:05.557877 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1456/2880] 10.222.0.20 () {60 vars in 1384 bytes} [Tue Jul 12 08:49:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 12 08:49:08.671565 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad330c9-eb4e-472f-8b1d-5662dd35b486 None None] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:49:08.673769 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-dad330c9-eb4e-472f-8b1d-5662dd35b486 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:49:08.693682 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad330c9-eb4e-472f-8b1d-5662dd35b486 None None] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:49:08.699000 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:49:08.699519 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:08.699806 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:08.700151 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:08.702879 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:49:08.716832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:49:08.718664 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:49:08.732393 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1425/2881] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:49:08 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 12 08:49:12.119715 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e11fe7-e92e-4557-a15f-1832f752b32d service swift] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:49:12.181986 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e11fe7-e92e-4557-a15f-1832f752b32d service swift] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:49:12.186656 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:49:12.187460 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:12.187739 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:12.188011 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] PATH_INFO: `/v3/users/479ad69bab3e44dc86f856566b5239a3` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:12.189190 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] RBAC: Authorizing `identity:delete_user(user_id=479ad69bab3e44dc86f856566b5239a3)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:49:12.191156 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:49:12.236576 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '479ad69bab3e44dc86f856566b5239a3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.243267 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '479ad69bab3e44dc86f856566b5239a3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.251444 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '479ad69bab3e44dc86f856566b5239a3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.263150 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '479ad69bab3e44dc86f856566b5239a3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.263813 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '479ad69bab3e44dc86f856566b5239a3'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.269787 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1457/2882] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:49:12 2022] DELETE /identity/v3/users/479ad69bab3e44dc86f856566b5239a3 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:49:12.443732 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:49:12.460289 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c910ec80-0723-4085-bc54-a9a23358e4c1 service placement] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:49:12.520803 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:49:12.521678 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:12.521956 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:12.522224 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] PATH_INFO: `/v3/projects/efce4a5c7d7b40ca9fe23b3fe62e4982` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:12.523439 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] RBAC: Authorizing `identity:delete_project(project_id=efce4a5c7d7b40ca9fe23b3fe62e4982)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:49:12.525378 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:49:12.571128 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'efce4a5c7d7b40ca9fe23b3fe62e4982', 'request_id': 'req-d16fef65-ed6d-4183-8abf-354461991e4d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.577134 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'efce4a5c7d7b40ca9fe23b3fe62e4982', 'request_id': 'req-d16fef65-ed6d-4183-8abf-354461991e4d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.584202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'efce4a5c7d7b40ca9fe23b3fe62e4982', 'request_id': 'req-d16fef65-ed6d-4183-8abf-354461991e4d'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.595704 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] The token cache is being invalidate because project efce4a5c7d7b40ca9fe23b3fe62e4982 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:49:12.595994 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.596615 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.598186 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1426/2883] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:49:12 2022] DELETE /identity/v3/projects/efce4a5c7d7b40ca9fe23b3fe62e4982 => generated 0 bytes in 155 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:49:12.602121 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:49:12.603544 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:49:12.616604 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6418c31-0b95-42ab-b5f1-7a02a30b4b4b admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:49:12.664272 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:49:12.676033 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:49:12.676970 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:12.677301 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:12.677657 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] PATH_INFO: `/v3/users/24a4473ae8004ebd95a08fbebe479668` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:12.678911 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] RBAC: Authorizing `identity:delete_user(user_id=24a4473ae8004ebd95a08fbebe479668)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:49:12.680941 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:49:12.726843 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '24a4473ae8004ebd95a08fbebe479668'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.733667 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '24a4473ae8004ebd95a08fbebe479668'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.741392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '24a4473ae8004ebd95a08fbebe479668'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.753827 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '24a4473ae8004ebd95a08fbebe479668'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.754449 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-bf9d47a9-6f8d-4948-a857-2d8d1d6b8517 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '24a4473ae8004ebd95a08fbebe479668'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:12.760198 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1458/2884] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:49:12 2022] DELETE /identity/v3/users/24a4473ae8004ebd95a08fbebe479668 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:49:12.935883 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:49:12.937345 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:49:12.949622 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d16fef65-ed6d-4183-8abf-354461991e4d admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:49:13.009715 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:49:13.010581 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:13.010869 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:13.011149 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] PATH_INFO: `/v3/projects/7b6e89f170ab48f0a9bbab07a6cc0075` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:13.012331 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b6e89f170ab48f0a9bbab07a6cc0075)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:49:13.015081 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:49:13.026085 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:49:13.063548 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b6e89f170ab48f0a9bbab07a6cc0075', 'request_id': 'req-14ad3916-c67d-4fb5-a138-c2f64abc17e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:13.068878 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b6e89f170ab48f0a9bbab07a6cc0075', 'request_id': 'req-14ad3916-c67d-4fb5-a138-c2f64abc17e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:13.078753 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b6e89f170ab48f0a9bbab07a6cc0075', 'request_id': 'req-14ad3916-c67d-4fb5-a138-c2f64abc17e0'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:13.090253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] The token cache is being invalidate because project 7b6e89f170ab48f0a9bbab07a6cc0075 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80192) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:49:13.090534 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:13.091346 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:49:13.092891 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1427/2885] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:49:12 2022] DELETE /identity/v3/projects/7b6e89f170ab48f0a9bbab07a6cc0075 => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:49:22.756835 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=29,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:49:23.086904 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=19,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:49:30.935651 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824782-ccdc-4e27-a81e-0a5d6c450ccb None None] REQUEST_METHOD: `POST` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:30.936211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824782-ccdc-4e27-a81e-0a5d6c450ccb None None] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:30.936211 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2824782-ccdc-4e27-a81e-0a5d6c450ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:30.954465 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.auth.core [None req-c2824782-ccdc-4e27-a81e-0a5d6c450ccb None None] MFA Rules not processed for user `0b215dd8b36942d291591d77dd661e82`. Rule list: `[]` (Enabled: `True`). {{(pid=80191) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 12 08:49:30.955644 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c2824782-ccdc-4e27-a81e-0a5d6c450ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:49:31.008862 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1459/2886] 10.222.0.20 () {58 vars in 957 bytes} [Tue Jul 12 08:49:30 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 12 08:49:38.877274 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:49:38.878696 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:49:38.934201 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ad3916-c67d-4fb5-a138-c2f64abc17e0 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:49:38.938291 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:49:38.938922 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:49:38.939200 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:49:38.939508 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:49:38.941367 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:49:38.951618 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:49:38.953571 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:49:38.962161 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1428/2887] 10.222.0.20 () {60 vars in 1396 bytes} [Tue Jul 12 08:49:38 2022] GET /identity/v3/auth/tokens?allow_expired=1 => generated 3244 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:49:41.002385 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=25 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:49:48.958253 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=26 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:50:56.789099 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2824782-ccdc-4e27-a81e-0a5d6c450ccb None None] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:50:56.790537 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c2824782-ccdc-4e27-a81e-0a5d6c450ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:50:56.858889 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2824782-ccdc-4e27-a81e-0a5d6c450ccb None None] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:50:56.863880 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:50:56.864515 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:50:56.864792 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:50:56.865063 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:50:56.866817 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:50:56.878466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:50:56.880023 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:50:56.890372 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1460/2888] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:50:56 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:51:06.885524 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=32 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:51:39.556724 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:51:39.565601 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1a1f2a8-0230-45c3-aa44-b3922d3ee068 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:51:39.569259 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '686a32aea0b945d9a76875110c8f84ca', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:51:39.569929 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:51:39.570210 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:51:39.570482 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:51:39.572202 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:51:39.633954 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:51:39.635310 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:51:39.644748 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1429/2889] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:51:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:51:45.688574 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:51:45.690439 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:51:45.711191 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10e780b-d58d-46d9-95b0-61656443f071 service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:51:45.716687 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:51:45.717735 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] REQUEST_METHOD: `GET` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:51:45.718252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:51:45.718732 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:51:45.722223 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:51:45.747280 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:51:45.749324 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:51:45.764127 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:51:45.766268 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:51:45.770450 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1461/2890] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:51:45 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:51:45.786667 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc6228a-4248-4694-8779-d3e7750a7502 service neutron] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:51:45.791877 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:51:45.793013 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:51:45.793484 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:51:45.794747 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] PATH_INFO: `/v3/users/0b215dd8b36942d291591d77dd661e82` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:51:45.795084 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0b215dd8b36942d291591d77dd661e82)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:51:45.797103 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:51:45.855553 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0b215dd8b36942d291591d77dd661e82'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:45.867693 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0b215dd8b36942d291591d77dd661e82'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:45.874415 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0b215dd8b36942d291591d77dd661e82'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:45.881675 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0b215dd8b36942d291591d77dd661e82'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:45.882380 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0b215dd8b36942d291591d77dd661e82'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:45.888440 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1430/2891] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:51:45 2022] DELETE /identity/v3/users/0b215dd8b36942d291591d77dd661e82 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:51:46.068639 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:51:46.080126 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af136165-85ab-4330-9368-b3476b6578ee service placement] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:51:46.138466 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:51:46.139323 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:51:46.139601 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:51:46.139875 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] PATH_INFO: `/v3/projects/b83f1ec2255f4957903a1b8f165c47c0` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:51:46.141064 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b83f1ec2255f4957903a1b8f165c47c0)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:51:46.143002 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:51:46.191680 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b83f1ec2255f4957903a1b8f165c47c0', 'request_id': 'req-02d3b86e-1c41-4828-b51b-2581e2539f41'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.197798 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b83f1ec2255f4957903a1b8f165c47c0', 'request_id': 'req-02d3b86e-1c41-4828-b51b-2581e2539f41'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.204602 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b83f1ec2255f4957903a1b8f165c47c0', 'request_id': 'req-02d3b86e-1c41-4828-b51b-2581e2539f41'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.214717 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] The token cache is being invalidate because project b83f1ec2255f4957903a1b8f165c47c0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:51:46.214999 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.215613 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.217129 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1462/2892] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:51:46 2022] DELETE /identity/v3/projects/b83f1ec2255f4957903a1b8f165c47c0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:51:46.221107 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:51:46.222608 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:51:46.236650 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f10b99-c4e8-4708-821e-1e6f9f316af3 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:51:46.293832 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:51:46.294633 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:51:46.294914 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:51:46.295187 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] PATH_INFO: `/v3/users/3d1f1b4605444019a2f55fb9edaec7bd` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:51:46.296379 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3d1f1b4605444019a2f55fb9edaec7bd)` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:51:46.298337 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:51:46.303943 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:51:46.345294 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3d1f1b4605444019a2f55fb9edaec7bd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.357363 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3d1f1b4605444019a2f55fb9edaec7bd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.363982 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3d1f1b4605444019a2f55fb9edaec7bd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.371614 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3d1f1b4605444019a2f55fb9edaec7bd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.372324 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.notifications [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3d1f1b4605444019a2f55fb9edaec7bd'} {{(pid=80192) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.378073 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1431/2893] 10.222.0.20 () {58 vars in 1223 bytes} [Tue Jul 12 08:51:46 2022] DELETE /identity/v3/users/3d1f1b4605444019a2f55fb9edaec7bd => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:51:46.548780 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] Authenticating user token {{(pid=80191) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:51:46.550299 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.fernet_utils [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80191) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:51:46.563392 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3b86e-1c41-4828-b51b-2581e2539f41 admin admin] Validating token access rules against request {{(pid=80191) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:51:46.622424 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a284f7c10ba148eab43b0163d0db6ba7', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '9d63d9615eff4164ace798b1726ec64c', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80191) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:51:46.623281 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:51:46.623555 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:51:46.623824 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] PATH_INFO: `/v3/projects/ff94ce73b2844afe96f6561b9b5e320e` {{(pid=80191) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:51:46.624974 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff94ce73b2844afe96f6561b9b5e320e)` {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:51:46.626898 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] RBAC: Authorization granted {{(pid=80191) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:51:46.649248 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:51:46.674106 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff94ce73b2844afe96f6561b9b5e320e', 'request_id': 'req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.680252 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff94ce73b2844afe96f6561b9b5e320e', 'request_id': 'req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.687501 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff94ce73b2844afe96f6561b9b5e320e', 'request_id': 'req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d'} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.698207 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] The token cache is being invalidate because project ff94ce73b2844afe96f6561b9b5e320e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80191) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 12 08:51:46.698818 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.699192 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG keystone.notifications [None req-2abfe8a7-38cd-4c7b-85a8-8dde0e43dd7d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80191) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 12 08:51:46.700723 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: [pid: 80191|app: 0|req: 1463/2894] 10.222.0.20 () {58 vars in 1232 bytes} [Tue Jul 12 08:51:46 2022] DELETE /identity/v3/projects/ff94ce73b2844afe96f6561b9b5e320e => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 12 08:51:56.374680 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=23,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:51:56.695433 dv-cinder-797608-54-iscsi devstack@keystone.service[80191]: DEBUG dbcounter [-] [80191] Writing DB stats keystone:SELECT=16,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80191) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 12 08:55:58.742194 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] Authenticating user token {{(pid=80192) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 12 08:55:58.743635 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:55:58.880813 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585f70f0-c52f-45f6-868c-719452a73ac9 admin admin] Validating token access rules against request {{(pid=80192) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 12 08:55:58.940297 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92a38002-a623-438e-a203-5c020fdb54f1 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '94eb335ec8004aa493080367f844d730', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'd604d0b921624779aba7be0fb8f5efa5', 'project_domain_id': 'default', 'roles': ['reader', 'service', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80192) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 12 08:55:58.940940 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38002-a623-438e-a203-5c020fdb54f1 service placement] REQUEST_METHOD: `GET` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 12 08:55:58.941223 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38002-a623-438e-a203-5c020fdb54f1 service placement] SCRIPT_NAME: `/identity` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 12 08:55:58.941529 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92a38002-a623-438e-a203-5c020fdb54f1 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80192) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 12 08:55:58.944582 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.fernet_utils [None req-92a38002-a623-438e-a203-5c020fdb54f1 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80192) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 12 08:55:58.955665 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38002-a623-438e-a203-5c020fdb54f1 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 12 08:55:58.957246 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92a38002-a623-438e-a203-5c020fdb54f1 service placement] RBAC: Authorization granted {{(pid=80192) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 12 08:55:58.969074 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: [pid: 80192|app: 0|req: 1432/2895] 10.222.0.20 () {60 vars in 1365 bytes} [Tue Jul 12 08:55:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 12 08:56:08.964842 dv-cinder-797608-54-iscsi devstack@keystone.service[80192]: DEBUG dbcounter [-] [80192] Writing DB stats keystone:SELECT=89 {{(pid=80192) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}